heredami comments on 2013 Survey Results - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (558)
The standard way to fix this is to run them on half the data only and then test their predictive power on the other half. This eliminates almost all spurious correlations.
Alternatively, Bonferroni correction.
That's roughly what Yvain did, by taking into consideration the number of correlations tested when setting the significance level.