If I'm not mistaken, such restrictions don't exist in other similar games like Baldur's Gate 2 or Divinity: Original Sin 1 & 2, so it feels odd encountering them in this game. Of course, I'm not saying that this game should work like those other games despite my personal preference, but given the precedent set by them, and those games were popular too, this kind of differences should at least be explained in the tutorials if they are indeed working as intended.