You can't just unequip the lantern for fights in Act II so the slot isn't really useful there. It's just for quickly getting a lightsource out while exploring. Except even the darkest dungeons of the goddess of darkness are very well lit in this game. They just couldn't let go of having every place in the game look really pretty.
