I was pickpocketing the drunk sleeping goblins (and bugbear) on the high passage, but got caught, and then all the goblins oautside went to the attack. Even though I was already Lev. 4 at that time, I thought it would be hopeless against 20 enemies, including the ogre at the gate.

But , they couldn't get to me in my osition. I meleed with 4 or 5 who were in that place, (the drunks I pickpocketed) which was do-able. The others were unable to ascent to where I was and climbed on other platforms and a missile combat ensued.

Gale used all his magic missiles to dispatch the ogre, who could only curse, but not reach us.

Spoiler : There were 5 goblins on a wooden platform in front and we were shooting arrows at eachother.
After 4 were down, I noticed that a wooden pole under the platform showed up as having 2 HP (because the bow's target browsed over it as I aimed for the last goblin)
I shot two arrows at this pole and the whole platform came down.
I could probably have killed these 5 gobs with 2 arrows from the beginning.