Check if you have Caps Lock enabled. Like holding down the Shift key, this will let you to move the screen focus away from your character, but has the problems you described when teleporting (or taking stairs, etc).