Same for me on Xbox Series X, hopefully it gets patched. I submitted a bug report on Larian's main website and anyone else who encountered this does, if they haven't already.