This hasn’t been my experience lately, but it may have been on my first playthrough — I can’t quite remember.
In any case, forgive me if this too obvious, but magic armor should protect you from burning. You could craft Magic Armor potions and/or use the skill (or craft scrolls) Armour of Frost.
