Unfortunately, I don't think there is a way to avoid that.
I know you get a warning when you have the contract that you will not be able to return to Broken Valley, but thought you could get up to just before the summoning room. I guess going up to the third floor and telling Sassan the demon's name is the point of no return, then...
