Hey Shanklust! It's not your controller; do not adjust your television set.
If you want a good perspective on what's buggy and what's not, I'd recommend you take a glance over the spell focus thread, in the stickies, and if you can dig it up, the status effect focus thread as well. That will save you a number of confusions about 'why is that happening' as you play.
Edit: these ones!
https://forums.larian.com/ubbthreads.php?ubb=showflat&Number=739350#Post739350https://forums.larian.com/ubbthreads.php?ubb=showflat&Number=739348#Post739348