You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Despard comments on [Link] Nobel laureate challenges psychologists to clean up their act - Less Wrong Discussion

13 Post author: mstevens 03 October 2012 05:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread.

Comment author: Despard 03 October 2012 08:35:26PM 2 points [-]

Nice article. Much of psychology suffers from the failure to replicate experiments, for various reasons like funding, time pressure, and difficulties in obtaining the population required. I've worked in sensorimotor control for several years and recently some researchers have come up with the idea of putting together a database of studies on perturbations during reaching (which is a very widely used paradigm) because they can so often be divergent due to tiny changes in the experiments.

I'd love to see more of this kind of thing in psychology in general, just as I'd like to see registration of medical trials from pharmaceutical companies (with both negative and positive results published) to avoid the all-too pervasive publication bias.

Comment author: GeraldMonroe 03 October 2012 09:17:12PM 0 points [-]

How would registry of the trials work?

When I heard a lecture on this subject (there is pretty damning statistical evidence that drug trials are always slanted towards the company paying for the trials) the only viable proposal I heard discussed was to have the testing completely performed and controlled by an unbiased third party. (probably the government)

Comment author: Despard 04 October 2012 03:05:54PM 4 points [-]

It's not necessary to have them completely performed and controlled by a third party - but the idea is if you want to do a drug trial, you sign up with an independent register saying which drug you're testing and what your methodology is. Then when the trial is done, you must report your results publicly.

That stops companies hiding negative trials and only publishing positive ones. It doesn't stop the data being manipulated, but that's another problem.