I prefer my fights to not take two hours. It's not like you're going to lose the goblin fight if you have the high ground regardless.

At the end of the day it really negatively impacts magic more than anything else. You may not like killing in one hit, but you better kill in one hit if you have a limited number of spell slots. That mixed with the long rest issue takes a lot of strategy out of the game and ultimately kills the fun of a wizard. You need meaningful choices to enjoy successfully doing something.