The window to edit my post has closed so as a follow up:

This is happening in multiplayer in the definitive edition. It apparently doesn't take AP but puts the skills into cooldown.

It happens only to me as the person not hosting. This didn't happen our first few days of playing...

Very frustrating stuff- especially when playing at a higher difficulty level. Has anyone else experienced this at all?