I agree that inventory interactions should be tweaked to avoid egregious abuses like people getting +2 AC because their shield is on their back. Other than that sort of thing, I think that most of the time somatic components can be performed like people have said, taking a hand off a weapon.
In Solasta, which has no Warcaster, I eventually had my Cleric just put away their weapon and go full caster + shield.
