This explained why I got the weird lagging after I killed the guards (my 200 gold is not for them) to enter the Sharess's Caress area lol
I wonder if it's because how strange the aggro range guards in the Wyrm's Rock tower is. I once aggroed literally the whole tower because I failed that persuasion check at the potential vendor. Perhaps having 20+ NPCs constantly checking me for my shenanigans broke the game.
