Sure, trying to make due with 49 ability points can be rough if you're actually trying to pay for the 4th and 5th point. That's generally why you try to use gear with ability bonuses on it instead. It's a lot easier getting multiple skills to 5 when it costs only 6 points instead of 15 points.
But then that gear is otherwise worthless more often than not and to keep rotating gear is a different pain...especially when the inventory system is the mess it is, filters only do so much.