AstraSequi comments on The Thyroid Madness: Two Apparently Contradictory Studies. Proof? - Less Wrong

7 Post author: johnlawrenceaspden 10 April 2016 08:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (76)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 19 April 2016 08:49:15PM 1 point [-]

in biology, you can use peer-reviewed evidence to make plausible arguments for arbitrary hypotheses.

Et tu, Brut? That is obviously true for humanities and for things like observational studies of nutrition, but do you think it extends to most / all of biology? "For any hypothesis there is a mouse strain which proves it true"? :-/

Comment author: Lumifer 21 April 2016 05:09:53PM 3 points [-]

Hmmm

This piece claims that

...we face a replication crisis in the field of biomedicine, not unlike the one we’ve seen in psychology but with far more dire implications. Sloppy data analysis, contaminated lab materials, and poor experimental design all contribute to the problem.

...Freedman and his co-authors guessed that fully half of all results rest on shaky ground, and might not be replicable in other labs. These cancer studies don’t merely fail to find a cure; they might not offer any useful data whatsoever.

Comment author: AstraSequi 23 April 2016 02:01:35PM 1 point [-]

This open-access article discusses some of the issues in cancer research.

In most ways biology is intermediate between the hard and soft sciences, with all that implies. It’s usually impossible to identify all the confounders, most biologists are not trained in statistics, experiments are complex and you can get different results from slight variations in protocol, we're trying to generalize from imperfect models, many high-profile results don’t get tested by other labs, ... all these factors come together and we get something that people call a “replication crisis.”

Comment author: Lumifer 23 April 2016 06:15:57PM 1 point [-]

tl;dr It's complicated.

Yes, I know. But it would be nice if people recognized that it is complicated and not pretend that we know more than we actually do.