As it stands a martial party might not need to long rest for ages, but a full caster one will need one quite often. How do you balance that in the game - I am not sure.
You increase the party size so everyone has to rest less often.
I am not in the camp of increasing the party size, I think 4 is a good size, both for BG3 and 5e.