I'd say once you are lvl 4-6, it's really worth the loss of XP.
You not only can gain equipment and quests, but also skill points, or character points.