Again, the most problem is the rest system is that Larian designed the game with all the major cut scenes and story progression to happen at camp or right before and after long rests.
This was so that you are almost forced into doing so, manipulated into resting more than you need to in order to get the full experience and story of the characters. It ties back into Larian designing the game for the lowest common denominator and adding so many training wheels facets to the flow of the game.
If you follow the long rest regimen set by the game in EA, you will have your spell slots available roughly every other fight.
Exactly! It breaks class balance and immersion.