Yep - it has proved a major annoyance for me on multiple occasions. It's basically a free action for the AI - which it uses a lot (as a decent programmed optimizer would). Certainly in my playthroughs.
I really hope Larian wil consider changing this after release