I mean, those gloves literally give you one of the heaviest debuffs in the game if you use them without being "Marked" in a specific quest. "Using them or not changes nothing". Could you be any more clueless about the game's mechanic if you tried?
Party control in Baldur's Gate 3 is a complete mess that begs to be addressed. SAY NO TO THE TOILET CHAIN