I finally found one downside to frequent long resting:
Nere dies if you long rest too often after you get to the Grymforge.

I have not found a single other instance where there's a penalty for long-resting all the time though.