Spell points for a Warlock are nerfed badly at only 4 points per long rest, at level 4 using a Single Short rest. Almost half of any other caster (7 Per long rest at 4th level)

DM's Guide page 84 " In general, over the course of a full adventuring day, the party will likely need to take two short rests, about one-third and two-thirds of the way through."

There are also difficult encounters where having a timed short rest is well needed if the party is moving on from another battle.

Please extend the uses to 2 short rests, and or a timer between them like a cooldown.