I haven't had any problems with dragging, but I found you have to aim for the very bottom of the slot (aming for the centre didn't register a 'hit'). Wait until you see the spell icon appear in the slot before releasing the mouse.