They do it in the Nautiloid when playing multiplayer: they add a 5th member to the party (without any mod) when it's needed for the storyline. So I don't get why they don't allow it later as well...