There's a second house later. That's just the first step in the quest, you're fine. As for which way you want to go, that's up to you to decide. But your decision may have consequences later.