Larian is aware of the multiplayer issues and hopefully a hotfix will be coming soon, because right now multiplayer is unplayable.

https://twitter.com/larianstudios/status/1313920589334294528