It does seem like the number of long rests is by design. I was getting story content all the way the way through my last playthrough, and I feel like it explored everything.
Also I tend to limit them because I'm afraid there is some potential consequence, like that tadpole might actually burst through if you take to long.
Or worse yet, Gale insists on eating another one of my blue magic items.