Absolutely.
It's ridiculous yet acceptable to have the normal outfit (and gear) during the normal sleeps. Because doing so requires less development time, and little player attention is brought to the sleeping. So everyone can agree to ignore it.
But with the dream sequences, Larian is really drawing our attention on the sleep. And not even that, but a dream. So in these cut-scenes, our characters should not wear their standard adventuring equipment.