There literally is an easy swap option during combat; There's a slot right above your melee weapon, that's where a torch goes.
Sure, the button to swap between them is stealthy, but it's there.

I don't want to think about why my eye is itching.