I think I might have figured it out. After defeating the fight out in front of the grove, I did not go in through the front gate. I messed around and found my way in through a hidden side door. I never had the introductory dialogue with zevlor that happens right inside the gate. I'm doing another character and I went in right after the fight and I've had no problems with Zevlor.
