Access to Longstrider and Disguise Self can mitigate such effects, and, if you start as Bard, you can have those from level one on, and its not even a bad idea to pick these two among the four spells you get at level 1.
Especially if you are very specialized into an action, Halfling very substantially offers an advantage to doing this action, especially once you're so good at a task that you will even succeed on a 2.
P.s.: Actually not sure on Disguise Self.
I don't think Disguise Self changes your speed, though I could be wrong. D&D rules don't say it does, although they also say you can only change your height by 1 foot.
It would be weird to cast Disguise Self on yourself to change between small & medium height. Imagine every time you start a conversation, the other person is either looking way above your real head, or down at your waist.
