Nope, that would not break the quest. Even if you had waited until finding the cave, etc. to confront the doctor, he just claims he lost the key to the room in the cellar (with the poison barrels), and someone else must have found it. Just keep going with the quest, and search the house when your character has circumstantial evidence that the doctor is involved.
