Well, if you are a mage, you should be able to take them out at level 13 with a few trips back to the bed, or a few magic potions.
The guards are -weak-. I took out the whole camp no problem at level 13.