I would prefer health and mana regeneration to none. No mana regeneration in Morrowind was really painful, and in this game relying only on potions would be really expensive and tedious.
What I do when I need to regenerate is to wait around in the start area of Broken Valley or Lovis' Tower and listen to the great music.