It can happen in single player, as well. In my game (IIRC started in 1.0.93 or 95) they would say they joined, but they don't get a portrait and do not follow. Dismissing them works, and they go to the King Crab inn (no homestead at the time), where they will rejoin, but stay where they are.
