Anyone know if there's a way to swap party members without ending the day at camp? I can't seem to find it if there is.

There should definitely be a way to change out party members without having to end the whole day and resting.