Without global cool down I can prebuff a character before combat. Well i do anyways but I could do it more without some running out before I finish.

That would be my main objection to changing it. Other than that yeah, it cam be a little annoying but I see the purpose.