If it's too difficult, do some other fights for an extra level. Isn't the judge and others level 5? Can't remember.
Try the courtyard fight, the 2 guys near Kniles, finish up any quests up top like Emmie the dog and Migo.
As for the fight itself, I usually enter through the main door, so I'm standing on top near the 2 stairs. While he's talking, I position my people. Use your mages to take out the melee guys bc they have low magic armor, so you can CC them easily once that is broken. Send your fighter/tank or w/e have you through the gate on your right side (should be right side if ur entering through main gate), and have him go after the mages, and keep him busy. Make sure your healer/support can reach the tank as well to help him out once needed. If you have another physical, like a rogue or ranger, use them to target the mages as well. Check the armor. Some have more physical, some have more magical. Usually bosses/minibosses tend to have a lot of armor on both ends, but sometimes one is lower then the other.