@virion This is basically the principle that "only the happiest or the most unhappy people leave feedback," right? Therefore, no forum (or steam reviews or whatever) will actually be representative of the true population of players?
I could accept this, with the following caveat. As this product is in EA, many so-called 6-8s might have a stronger desire to participate in the forums than they would otherwise. Quite possibly to advocate against changes by saying that they're happy enough with the current game. This would actually increase the number of "effective 9/10" posters.
Or the opposite could happen: people who would otherwise just rate the game as "fine" are encouraged to find flaws that they'd otherwise not comment on...
1)this is basically the principle that "only the happiest or the most unhappy people leave feedback," right? Therefore, no forum (or steam reviews or whatever) will actually be representative of the true population of players?
Kinda. But the point is rather that we don't care about the true population of players as long as they are " overall happy". They might leave feedback but we pat them on their head and ignore them. Kinda funny how Electronic Arts did the exact opposite for a long time.
2) The context of the EA is really important too and I skipped it, you are right. Which might explain to some extent why nearly 38% voted 9+ on recommending the EA to others. The low number of respondents it's also one of the reasons. Together with other questions being formulated very poorly and orienting the answers(that last statement can be argued about forever, creating a reliable survey is super complex though). https://drive.google.com/file/d/1IgN2IAZi8Hho6X_7XpiW-0N_cUYEJvX8/view
The whole reason for approaching data this way is to keep a good "overall" image and eleminate people demoting the product. Enhancing on aspects helping to promote the product is a secondary task.
I talk about this because for some reason people tend to bring this " Niche vs Majority" argument in discussions about features. "If the majority doesn't like it , then it doesn't make sense to even talk about it seriously". It's not the case. The end result will be a few % of people telling you not to buy bg and a few % telling you to buy it at all cost. The 2nd group should be higher than the 1st one.
When you think of it the idea of collecting feedback based of a forum is actually problematic due to this last paragraph alone. A person adressing an issue vocally and saying it's a gigantic issue might be a promoter in reality.
The whole system exists as a customer satisfaction initiative aiming at controlling the image of a company and it's products. That's why it's problematic to apply it to software development in it's pure form too. But with the magic of "telemetry" implemented in video games you could go as far as trying to force the feedback via ingame pop-up at the end of let's say 10 hours of gameplay(after finishing a session for instance) just to get the " satisfaction" number. And then you would know if the majority actually matters.
I think I need to change my life choices and go to game dev, I'm so curious what this data could bring.