Familiars are really exploitable. The Imp warlocks get can invis stealth into a group of enemies, attack one, fly away without provoking opportunity attacks, and then hide as a bonus action. Then next turn they can invis and stealth back in, and the next turn start the whole thing over again. After the familiar hides the AI dont look for it or anything. Im able to send my familiar across the map alone and solo encounters with no cost since it doesnt use a spell slot.
This could be solved by not letting the familiar hide as a bonus action. While the process might sound tedious, it's pretty easy once you get the hang of it and I was even able to solo the four level four gnolls outside the blighted village with JUST the familiar.
Even if you mess up and the familiar dies, you can just try again for free. The only case you wouldn't be able to do this is in an enclosed environment or there being so many enemies there is no place you can feasible go to hide even with flight and movement.
This is not a familiar problem; a lot of what they have done with familiars is actually fairly understandable, and allows for a lot of tricks. The problem is that combat stealth is totally broken. Try stealthing on a ledge, shooting an arrow at foes, then hiding again as you end the turn. The enemy will do the same thing - just stand around and wait to die. This has been reported multiple times already.