Ok, I've just tried that and it was ridiculously easy. They couldn't reach me with the melee fighters and didn't do a lot of damage (some arrows, but not much). It took me a while, but I cleared the whole courtyard eventually.
I'm glad, I now know, that I can get the owlbear without taking them all on, because I don't know, if I want to do that in every playthrough (but of course I want to save the little fluffball), but it's good to know, that it is doable.