We couldn't teleport out with Saheila either. However, we just left her in the building, teleported out, killed every lone wolf outside and then led her home. This worked fine. So I assume this would work with Higba as well. Kill any magisters you might encounter on the way then lead him out. Nether swapping him with one of your characters should work too.
