The problem is that scrolls and potions are just not necessary, especially in late game.
What is a must have skill one needs at end game?
Nothing. Virtually anything you want to accomplish in this game, there's almost always an alternative way to achieve that goal.
That's a big design philosophy of these types of games: You are given
options to achieve your end goal. Some options are better than others on the surface, but it's up to you to mix and match as you see fit to enjoy the experience and complete the objectives.