Lumifer comments on Be Skeptical of Correlational Studies - Less Wrong

8 Post author: jkaufman 20 November 2013 10:19PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (43)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 21 November 2013 08:23:16PM 1 point [-]

Can we characterize better this area where correlations are especially suspect?

Epidemiological studies of diets (that is, health consequences of particular patterns of food intake) are all based on correlations and the great majority of them is junk.

Comment author: IlyaShpitser 21 November 2013 10:01:21PM *  1 point [-]

These days epi people mostly use g methods which are not junk (or rather, give correct answers given assumptions they make, and are quite a bit more sophisticated than just using conditional probabilities). How much epi do you know?

edit: Correction: not everyone uses g methods. There is obviously the "changing of the guard" issue. But g methods are very influential now. I also agree there is a lot of junk in data analysis. But I think the "junk" issue is not always (or even usually) due to the fact that the study was "based on correlations" (you are not being precise about what you mean here, but I interpreted you to mean that "people are not using correct methods for getting causal conclusions from observational data.")

Comment author: Lumifer 21 November 2013 10:16:25PM 1 point [-]

Not much. I've read a bunch of papers and some critiques... And I'm talking not so much about the methods as about the published claims and conclusions. Sophisticated methods are fine, the issue is their fragility. And, of course, you can't correct for what you don't know.