Anders_Sandberg comments on How Much Evidence Does It Take? - Less Wrong

34 Post author: Eliezer_Yudkowsky 24 September 2007 04:06AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (29)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Anders_Sandberg 24 September 2007 11:40:02AM 3 points [-]

This also shows why independently replicated scientific experiments (more independent boxes) are more important than experiments with high p-values (boxes with better likeliehood ratios).

Comment author: DanielLC 07 September 2011 07:11:34AM 4 points [-]

But the p-values go exponentially close to one with the size of the study. If you had three studies that used 11 boxes, vs. one with 33, you'd get exactly the same posterior probability for the ticket being a winner.

In other words, more experiments are exponentially more valuable than higher p-values, but higher p-values are exponentially cheaper.