Originally Posted by ArmouredHedgehog
Originally Posted by Sludge Khalid

Now going to your presented case: 2 out of 20000 in sample size complained about something. Is this sample size representative to say that this is not statistically valid? This statistically is insufficient to prove that the matter is not representative. The correct way to approach whether this is relevant or not would be to ask for 2000 of them (because the error margin of that sample is around 2p.p) If they would like to have blue flowers instead.


There are thousands of single or dual mention items that you would have to ask people about. Would it be better in terms of the construct validity? Yes Is it feasible? No
You are talking about validity in the context of a test. As the available feedback does not probe for anything in particular I wonder in what way the critereon of test validity is applicable to it at all. It applies when you are measuring something specific.
What we have can provide the basis for probing specific items.
I think we agree that a survey should follow the unstructured interview
Originally Posted by Sludge Khalid

Sorry for the misspellings. I’m not native
No problem, I am not a native english speaker either. In some ways my Latin is better grin


The things you would have to consider as it’s a qualitative report is whether this person is a specialist or not. That would be like weighing the opinion of someone who have gaming vision in BG3 context or just common folk. As I said, their opinions are statistically non-conclusive. Summing up : its not a yes but it’s not a no as well smile

Getting back to the subject, reading people comments seems unfruitful compared to actual research & both you and me are in agreement in that. As this is currently not being used, I’d suggest engaging in this topic and developing one. Guess googleforms do it for free as a platform. I’ll use my weekend to think about it. I’m not willing to spend my money further on this saga as I’ve already paid for the early access. If I find a free platform that accepts a huge amount of questions I’ll let you know.