DavidLS comments on Fixing Moral Hazards In Business Science - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (96)
Oh, interesting.
I had been assuming that participants needed to be drawn from the general population. If we don't think there's too much hazard there, I agree a points system would work. Some portion of the population would likely just enjoy the idea of receiving free product to test.
I would worry about sampling bias due to selection based on, say, enjoying points.
For studies in which people have to actively involve themselves and consent to participate, I believe that there is always going to be some sampling bias. At best we can make it really really small, at worst, we should state clearly what we believe are those biases in our population.
At worst, we will have a better understanding of what goes into the results.
Also, for some studies, the sampled population might, by necessity, be a subset of the population.