After further testing, I can confirm that it is a problem with the A command on the gamepad (Xbox1) but not just in combat or when using a skill.
I had the problem while using A in the inventory and having my character move, start a conversation or worse, steal from an NPC in the background.
It's difficult to replicate because sometimes it works or manifests but most of the time it does not. I have a hunch that the problem lies with the priority you set with the A button prompt or lack thereof.
I hope these details will be useful to the devs.