The main problem right now seems to me that you seem to need a mage (especially on hard which is what I'm playing at now after a bug forced me to restart). Hell, he doesn't even need to do damage, I just need someone to constantly readjust the battlefield to my advantage and heal my rogue so she can clear enemies.
Regarding moving around: It feels a bit weird, but stop walking so much. Teleport all the time. You have a button to teleport from anywhere. Do it. Those portals you can port to are everywhere.