Yes you are correct about the cursor clicks.
Its not you, its the game.
When interracting with UI elements every other mouse click hangs, which makes dealing with the inventory, chains, and all the rest very frustrating. Requiring harder clicks or more clicks to correct for the game's lack of responsiveness compounds the feeling of not being in control, or of the game just being on the fritz.
I also tried to jerk around in the options to see if it was a setting but found nothing.
Its not an isolated annoyance, like needing to double click/confirm to cast a buff spell on yourself (even if self target is the only viable option for the spell), since this actually pervades the whole experience and almost every interaction with the interface. Any time you have to select or move something in your inventory, change equipment, drink a potion, set up a spell in the hotbar, issue attacks or movement commands, or just selecting the character you want to control.
I agree, the click time threshold puts a big blinding spotlight on anything that might already feel off about the UI or control scheme, since half the time the click doesn't register.