You wouldn't necessarily have to do things every round.... You would determine yourself the time that is worth it.
Doing things during your turn mean doing things you want to do. Answering "no" (or toggle off) is taking time not to do somethings. It makes a huge difference to me.
As I already said, I had a lot of fun doing "more" things with my lore bard. I didnt with my valor bard (toggle off constantly). Saying yes/no is mostly the same as playing with toggles but in real time (which makes huge differences ofc. Pops-up rather than what we have now!!)