Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

jkaufman comments on How Much Evidence Does It Take? - box10.me on lesswrong.com

34 Post author: Eliezer_Yudkowsky 24 September 2007 04:06AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (30)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: jkaufman 18 March 2017 02:38:50PM 0 points [-]

Running "1000 experiments" if you don't have to publish negative results, can mean just slicing data until you find something. Someone with a large data set can just do this 100% of the time.

A replication is more informative, because it's not subject to nearly as much "find something new and publish it" bias.