You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

shminux comments on [Link] Why Science Is Not Necessarily Self-Correcting - Less Wrong Discussion

6 Post author: ChristianKl 13 October 2014 01:51PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (17)

You are viewing a single comment's thread.

Comment author: shminux 13 October 2014 10:44:31PM 2 points [-]

The article seems to be heavily biased towards psychology. I wonder if the "harder" sciences like physics, chemistry and biology suffer from the same issues to a similar degree.

Comment author: Salemicus 14 October 2014 01:11:50PM 5 points [-]

The author of the article, Ioannidis, has published extensively about the unreliability of reported medical and biochemical results, over a more than 10 year period. The article is not so much "biased" towards psychology, as focusing on that one area.

Comment author: shminux 14 October 2014 05:07:25PM 2 points [-]

Right, "focusing" is a better description. But I wonder if this focusing resulted in a generalization which is a bit too sweeping. The "publish or perish" race is certainly everywhere in academia, but its side effects might be better mitigated in some areas than in others.

Comment author: RichardKennaway 14 October 2014 12:05:28PM 5 points [-]

I think of the work on blue LEDs that recently got the physics Nobel.

Blue LEDs work. You can buy them off the shelf. Each one works pretty much every time.

Is there anything in sociology or psychology of which the same can be said?

Comment author: satt 15 October 2014 12:20:31AM 2 points [-]

Blue LEDs work. You can buy them off the shelf. Each one works pretty much every time.

Is there anything in sociology or psychology of which the same can be said?

Depends on whether "Each one works pretty much every time" means a phenomenon which works on pretty much every individual on pretty much every occasion, or a phenomenon which can simply be replicated reliably given a big enough sample.

I can think of nothing in sociology or psychology satisfying the former criterion. But the latter, weaker criterion seems to be satisfied by anchoring bias, which was replicated by 36 sites out of 36 in the Many Labs project, as indicated by its table of summary statistics.

Comment author: Desrtopa 15 October 2014 03:11:04PM 3 points [-]

Whether one counts anything in psychology as satisfying the former or not, I think depends on where one draws the line between psychology and neurology. There are certainly things we've discovered about how the brain works that tell us things about the thought processes of every human, but one might argue that these fall under the purview of neurology, and not psychology.

Comment author: RichardKennaway 15 October 2014 06:15:49AM 1 point [-]

Depends on whether "Each one works pretty much every time" means a phenomenon which works on pretty much every individual on pretty much every occasion, or a phenomenon which can simply be replicated reliably given a big enough sample.

Definitely the former. Each one, every time. The world around us is filled with such things, yet when it comes to the study of anything to do with living organisms, people dismiss the idea as "physics envy", a concept which makes no more sense than "separate magisteria", and serves the same function.

Comment author: [deleted] 14 October 2014 05:50:09PM 1 point [-]

CBT?

Comment author: ChristianKl 15 October 2014 03:02:49PM 1 point [-]

CBT has a proven chance to help, but it doesn't have a 100% success rate for anything.

Comment author: CronoDAS 14 October 2014 01:30:04AM 4 points [-]

If you count medicine as a subfield of biology, people are already well aware of problems there...

Comment author: ChristianKl 13 October 2014 10:49:49PM 2 points [-]

In psychology you have the controversial replication initiative. In physics you have nobody complain about people attempting replications.

Comment author: RichardKennaway 14 October 2014 12:06:29PM 6 points [-]

In physics you have nobody complain about people attempting replications.

Perhaps that is because the stuff actually replicates.