Yup, same for me in my single game with 3 custom characters - the wardrobe-system seems a bit broken right now. Also sometimes it's empty, even if I just put a character in there. Also: Why do we need a wardrobe? Why not just have them hanging out in camp as the hirelings/companions do. Can anyone explain to me why we need a wardrobe? The whole thing seems silly.
Rumour has it future patches will include a lion and a witch......