I agree with the stealth mechanic. For rogues with perks thats okay, or classes that use some kind of cloud action or cloud explosives (like ninjas).
But overall the AI should search for the threat on the last known position.
Maybe this is already kind of in works - or what are those white circles from our characters of there last position?