Actually, as of 5e (Worth nothing that both of those images are from 3e, and are not officially current), elves have some variance between their different subtypes (drow are the smallest, and wood elves are generally the tallest), however, they are characterised as falling into an average range between 4'7" at shortest and 5'10" at tallest; this is still shorter than human averages (which *start* at 5'10" and go up), but not by a greatly substantial deal.
I must admit, I was mistaken.
I'm pretty sure the image I posted was also valid for the FR setting (since in the 3rd edition was the vanilla or "default" setting of D&D) but the reference for the 5th edition actually respond to your description.
