Lumifer comments on Be Skeptical of Correlational Studies - Less Wrong

8 Post author: jkaufman 20 November 2013 10:19PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (43)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 21 November 2013 03:50:35PM *  5 points [-]

Is there any conventional wisdom in the stats community about how far to trust these kinds of adjustments?

In my experience there's no general answer other than the observation that if people did NOT adjust for confounders, it's usually a very bad sign. But if they did, you actually have to go read the paper and form your own opinion on whether their adjustments look reasonable, whether they did them correctly, whether they picked the right confounders (or just grabbed whatever characteristics they had handy), etc.

Typically people don't adjust properly because it's against their incentives to do so.