Something seems off or not working as intended in my opinion : normally, one must hold the Ctrl key to target an object or ground, but currently you can accidentally do so without holding that key.
In line with OP, I would suggest it would be better that attacks (clicks) do not trigger unless game notes you targeted something relevant, like an enemy creature (yellow/red) or red item. Of course, this logic would not apply to AOE.
So if you use an arrow or targeted spell accidentally off a target, the game would just do nothing and wait for a proper target-click.
To attack an item or a green creature, you would need to hold Ctrl.
( based on keybindings, this seems to be what is intended, but currently you can misclick and target anything it seems )
( nuance : some spells are both targeted and AOE due to Larian changes, like Firebolt and Ray of Ice, but I suggest they be treated at targeted with the above suggestion.)
