Have magic armor blocks teleport. Add 1 to the AP cost. Something like that might help. Or five it a chance to miss based on your int score compared to their finess.
Fights can easily be made trivial with teleport. At least in early access. I'm both fights with shriekers I just ported them on a ledge and they did nothing.
