if that's how you want to play it..
I feel we will disagree on many things

, but by principle, if a feature can be skipped or ignored and isn't designed to be a skippable minigame (like Gwent), then it's a bad feature that probably shouldn't be in the game.
I think you also pointed out an issue - someone who well manages resources and doesn't spam rests, can miss major story content because of that. So pacing your own rests isn't exactly trivial - you rest too often, and you might triviliaze encounter by spamming powerful spells that should be limited in use. Don't do that and you can miss story content. I am in the same camp. There is lots of companion and follower stuff I haven't seen, because I just don't rest often enough. That's not great.
In this case, however, I don't blame Larian. I think it is clever to include story content in camp - makes it feel more like part of the game. But it is awkward balancing act, otherwise one can ask, why resting or spells-per-rest are a thing to begin with. "Story content at camp" indicator might be some kind of a solution.