I thought he turned hostile if you refused him, even if you didn't have enough gold and said you would return when you did? I haven't tried that in the latest version, though, just the disk version.