I think that was the point.
In the Baldur's Gate series there has always been a world clock and adventuring at night was a thing, it yielded different encounters and well, gave the impression that time passed
Alongside dynamic weather, it is definitely something I would have high up my list of "quality of life" wishes for this title.