XFrequentist comments on Against NHST - Less Wrong

57 Post author: gwern 21 December 2012 04:45AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (62)

You are viewing a single comment's thread. Show more comments above.

Comment author: summerstay 21 December 2012 04:07:37PM 11 points [-]

Can you give me a concrete course of action to take when I am writing a paper reporting my results? Suppose I have created two versions of a website, and timed 30 people completing a task on each web site. The people on the second website were faster. I want my readers to believe that this wasn't merely a statistical coincidence. Normally, I would do a t-test to show this. What are you proposing I do instead? I don't want a generalization like "use Bayesian statistics, " but a concrete example of how one would test the data and report it in a paper.

Comment author: XFrequentist 21 December 2012 09:28:48PM 4 points [-]

You could use Bayesian estimation to compute credible differences in mean task completion time between your groups.

Described in excruciating detail in this pdf.