I'd very much like to know if playing the Alpha and/or Beta version will ruin the experience of the finished game for you when it is eventually released.
As someone who played D:OS cyseal like.. tooooo many times I can assure you.. yes.. yes it does damage the replayability and the first play experience massively. To the point where it can actually hurt your enjoyment of the game in a fundamental way, as you start to see the lines between 4th wall and immersion appear with ever growing contrast, especially when you see "live" how the devs write dialog, fix spelling mistakes etc...
I have a golden rule nowadays, and it's basically only a thing since D:OS, that is never ever do alpha/beta testing if I actually wanted to play the game when I backed for it or when the game is a RPG.
The best way to do balancing would still be a sort of Arena where all "group" combinations, spells and positions can be tested, and this would probably be fine. But even then the "first play" experience can imo suffer.