there is no way to attack the casters. and if you want to go into the camp, i think that you need to kill the soldiers.