You don't have to start all over again. Explore other places with easier mobs, solve some quests. Then, when you are stronger, you can come back to the talking door. PS Damn, I dont remember the talking door quest.
"Endure. In enduring, grow strong."
-Githzerai adage.