Let me explain this :
In D:OS2 for instance you have a goddamn necklace which prevents you from using your powers, if You play in Multiplayer mode then only 1 char can take off it's necklace after you completed 1 specific quest... in act 1
In BG3 it seems like it's the Very same.
I can agree with DOS2 but no with BG3.
Lae'zel keep telling you that this is your number 1 thing to do - as fast as possible. "We need to go to my people"
Shadowhart also - "We need to find a healer"
If you have Astorian in your party and go through his story -you will understand why he doesn't want to get rid of it.
Gale have double the problems - but he told you at the start what is your number 1 quest, get rid of the tadpole.
Will, yea he also want get rid of it - rescue Mizura, and she will help us.