Yeah, I've bumped against this as well. It's ridiculous.

I'm not sure how the current build determines the level of light or darkness, but it doesn't react well enough to what players do and what happens during a fight.