When you start over, you should play on Classic your first time through. That would be a better choice than trying to struggle through on Tactician.
In case you missed the big locked gate with the guards in front of it, you are a prisoner, and you are not allowed to roam free inside the fort. Of course the guards will attack you on sight. You are not allowed to be there.
