did you damage the war drums? that upsets them as of this patch
there are also restricted areas that can cause a fight i.e, the halfling merchent and the priestest home both get you in trouble unless they invite you there but only if someone sees you are in there... its like the army, what isn't reported didn't happen so its fine
I hadn't entered the would-be-castle through the door yet and didn't damage anything to my knowledge. I went the intimidation route to get past the outpost. No fighting. The goblins only had a problem with me after I grabbed the shield from that corpse and dug up the chest.
Narrator mentioned theft specifically and my bribe was about 60 something gold. The only thing I could have stolen from was the chest by the corpse. It's locked afterall.