I see what you're saying, and yeah that would be pretty damn annoying. it could very well be a bug or the engine isn't suited for that function (yet). I recall Larian wanting to implement a day/night cycle, maybe that had something to do with why it was scrapped (for now)