That's a Paladin problem and not Polearm Master problem.
On my Eldritch Knight PM is just a nice extra to sometimes get an AoO and use your BA for around 7 damage. Good, yes - OP, no.
3 to 5 smites on the same turn however are silly levels of OP. Especially in BG where you can build auto-crits. One DnD already fixed it to just one smite per turn. BG3 should do the same.