Yeah, it's bad and it has been bad for years. It was bad in DOS 2 as well.
Better get used to the idea that it's not going to change now.

Party control in Baldur's Gate 3 is a complete mess that begs to be addressed. SAY NO TO THE TOILET CHAIN