Psy-Kosh comments on Case study: abuse of frequentist statistics - Less Wrong

25 Post author: Cyan 21 February 2010 06:35AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (96)

You are viewing a single comment's thread. Show more comments above.

Comment author: SilasBarta 22 February 2010 12:30:46AM 2 points [-]

Okay, I think that makes sense. Let me put it into my own words:

The test is guaranteed to be not statistically significant merely by virtue of cutting up the outcome space into pieces, each of which has at least 5% chance of happening. And further, because the null hypothesis has been (arbitrarily) defined to be "the two methods are the same", statistical insignificance means a favorable result.

Does that about cover it? If so, that's pretty bad.

Comment author: Psy-Kosh 22 February 2010 12:38:32AM 0 points [-]

That's more or less my understanding of the situation.

And yes... that is indeed pretty bad. :)