satt comments on Against NHST - Less Wrong

57 Post author: gwern 21 December 2012 04:45AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (62)

You are viewing a single comment's thread. Show more comments above.

Comment author: satt 14 April 2013 03:02:25AM 2 points [-]

Learned a new term:

Proteus phenomenon: The Proteus phenomenon refers to the situation in which the first published study is often the most biased towards an extreme result (the winner’s curse). Subsequent replication studies tend to be less biased towards the extreme, often finding evidence of smaller effects or even contradicting the findings from the initial study.

Oh great, researchers are going to end up giving this all sorts of names. Joseph Banks Rhine called it the decline effect, while Yitzhak Rabin* calls it the Truth Wears Off effect (after the Jonah Lehrer article). And now we have the Proteus phenomenon. Clearly, I need to write a paper declaring my discovery of the It Was Here, I Swear! effect.

* Not that one.

Comment author: wedrifid 14 April 2013 03:31:40AM 1 point [-]

Clearly, I need to write a paper declaring my discovery of the It Was Here, I Swear! effect.

Make sure you cite my paper "Selection Effects and Regression to the Mean In Published Scientific Studies"