This sort of idea is suited to a challenge mode.
Yeah, in that case I wouldn't mind/don't care for it. I think one of the optional challenges in Deadfire was having to complete certain objectives within timeframe. It might act as an effective difficulty challenge, as players might not be able to farm all XP per level, and look for optimal/efficient routes.
