I'm pretty sure this is how it is in tabletop. You hopefully should be able to keep your familiar alive long enough that you wouldn't frequently need to recast it.
The game already broke wizard by letting you change spells as often as you want, so this is a minor issue, IMO.
