You can also put a dome of invulnerability over the portal. Your ranged party members can stand in the dome. Just make sure you keep concentration.

What I also find really helpful is to get scrolls of minor or major elementals for fights like these. You can place them in the front line as cannor fodder before the fight starts. Ice elementals are really good at slowing the enemy down or knocking them prone.