He shouldn't be in any of the houses but on the main square by the big statue of Ketheric, if I understood your description correctly. Also there should be a portal at the abandoned house where you first meet him, which then leads you to him. I hope this helps. (Also not having bear Halsin with you is a cosmetic advice because you otherwise might end up having a cut scene full of fur.)
