You can manually turn off any concentration effects. Combine this with manually entering turn based mode to prevent NPC's from moving and you can avoid accidental damage from persistent AoE spells.
As far as solving an unwanted attack, if they have the "Temporarily Hostile" effect from crime, you can leave the area (Such as getting far enough away to go to camp) and they will go back to normal when you return.
