Thrasymachus comments on Results of a One-Year Longitudinal Study of CFAR Alumni - LessWrong

33 Post author: Unnamed 12 December 2015 04:39AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (35)

You are viewing a single comment's thread.

Comment author: Thrasymachus 26 December 2015 12:05:22AM 4 points [-]

Congratulations on doing this sort of careful self-analysis. I'd like to recommend a further improvement.

Pre-register/Publish your intentions for these trials and analysis in advance

The file-drawer problem is well-known, as are the risks of post-hoc changes in analysis. Publishing what data you are gathering and the analyses you will perform on it reassure more skeptical people against both of these worries, and seems pretty easy to do.