I've also been having trouble with the random hostile npc's. I managed to stealth walk up to the weaver of time + imp and after talking to them they remained friendly, but with an attitude of -25.
I got a logg in my journal about evelyns lair after killing Diethmar for the staff of pendragon. Even though I hadn't read the note in her house yet or even talked to evelyn to begin with.
[img]
http://postimg.org/image/9s2yesx1r/[/img]