Nothing happens when you get close to the house? Do you have a recent save you can re-load?

If not, you can still get a key to the house;
Lost Items - guide and directory of inventory files

or get past the door;
Teleporting Anywhere, via hex editor

This will leave a broken quest, missed experience and a missed skill the queen bee would have taught you if you killed most of the wasps without killing any bees.