My wizard has had no issue, I must say.
The 'having to select the target character' when equipping or drinking potions/eating food is a real pain, though. I've wasted plenty of potions giving them to the wrong character, including drinking Poison Resistance by my PC and then sending Astarion through a cloud of poison.
