I'm not sure if it is a reputation prob. in your case: Did you kill both trolls by crossing the bridge? If not, maybe people don't think too good of your char? Some gamers had this XP, the soldiers were not friendly after that.
Kiya