I've always done it that way instead of giving Wulbren his hammer. First time it's how I thought you should do it, but since he's so ungrateful I now just don't want to give it to him. I usually kill the guards outside first, but they've always gone to the Inn for me after running to the docks outside.
