I was trying to avoid all the companions from joining my camp too. It was just a rule for the run but yes you can do that.