If you find the NPCs there more trouble than they are worth, you can keep them from joining combat by engaging the first in conversation, having the rest of the party continue on and start the fight, then end the conversation and have that character use a teleporter pyramid to join the rest of the party.