I tried that at times (delaying quests), but I did it mostly in FOV.
I think what happens is when you're at a lower level the difference in XP gain can be significant. So If I'm fighting five or more enemies in certain areas at a lower level each time that makes the difference in the long run.