Lumifer comments on Questions from an imaginary statistical methods exam - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (25)
That's an unnecessarily narrow (and entirely frequentist) approach.
Statistics is a toolbox for dealing with uncertainty.
I was responding to the original post, which said:
I realize my wording may have been suboptimal, but some of these biases (such as multiple comparisons) only make sense in a frequentist framework.
I was trying to explain why some of these methodological problems do not even apply in this example. It is not a matter of other evidence is strong enough to outweight the methodological flaws. These methodological flaws are irrelevant to questions about the individuals data points.
For example, problems arising from biased stopping rules would arise if you were trying to estimate the proportion of all locations that contain keys that open your door. However, a biased stopping rule makes absolutely no difference for the integrity of the individual data points.