Hello Calep. Welcome to the forum.

You should not use the switch to reveal the hatch to the dungeon when you arrive a second time.

Simply use the hatch under the bed to arrive in the dungeon?

Or is this hatch not there anymore?

http://www.facebook.com/dragoncommander
http://www.facebook.com/DivinityOriginalSin
http://www.youtube.com/larianstudios