I'll guess that respecing is exploited to some extent anyway. If ppl don't want to change the difficulty because of possibly more XP or better loot drops (if that's a thing) then they just respec their whole party before they face boss encounter X.