I didn't have any problems that couldn't be solved with a bit of strategy or by trying a different area first, and was never tempted to lower the difficulty setting.
A good general rule of thumb for RPGs is to always put off doing the main quests as long as possible. Periodic saves mean you can never get stuck somewhere with no way back, even if you do rush into an area too much above your level.
