You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

James_Miller comments on Open Thread, May 25 - May 31, 2015 - Less Wrong Discussion

3 Post author: Gondolinian 25 May 2015 12:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (301)

You are viewing a single comment's thread. Show more comments above.

Comment author: James_Miller 25 May 2015 04:08:10AM 10 points [-]

The purpose of peer review is not to uncover fraud.

And this is OK if the fraud rate is low, and unacceptable if it's high.

Real review of one's work begins after peer review is over and the work is examined by the scientific community at large.

I doubt this happens to more than a tiny number of papers, although probably the more important the result the more likely it will get reviewed.

Comment author: RichardKennaway 25 May 2015 09:16:00AM 5 points [-]

The purpose of peer review is not to uncover fraud.

And this is OK if the fraud rate is low, and unacceptable if it's high.

If a paper shows all its working, a competent reviewer can judge whether the work as reported is good. How will they detect that the report is a fabrication? All the reviewer sees is the story the author is telling. The reviewer may notice inconsistencies, such as repeated use of the same figures, or data with an implausible distribution, but they will generally have no way to compare the story with the actual facts of what happened in the lab.

Detecting and preventing fraud is a good thing, but I don't think peer review is a place where much of it can happen.