For that reason I usually get the owlbear cub before attacking the goblins.

I talk my way into getting it for free and I don't bother attacking the goblins outside before going inside to take out the leaders.