The idea isn't even that one should constantly go back to the previous camp.
The idea is PRECISELY to make "going back to the previous camp" just inconvenient enough to DISCOURAGE it. while not locking the option out completely for (bad) players who will desperately need it.

Party control in Baldur's Gate 3 is a complete mess that begs to be addressed. SAY NO TO THE TOILET CHAIN