i avoided being caught out by this by using the flag markers.
everytime i entered a dungeon or found the next entrance i marked it with either "up" or "down". a simple thing to do to keep you right. in the battlefield itself i marked completed dungeons as well.
worth it in the long run !