You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Salemicus comments on Taking "correlation does not imply causation" back from the internet - Less Wrong Discussion

41 Post author: sixes_and_sevens 03 October 2012 12:18PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (70)

You are viewing a single comment's thread. Show more comments above.

Comment author: Salemicus 03 October 2012 09:00:18PM 12 points [-]

There's also e): A causes B within our sample, but A does not cause B generally, or in the sense that we care about.

For example, suppose a teacher gives out a gold star whenever a pupil does a good piece of work, and this causes the pupil to work harder. Suppose also that this effect is greatest on mediocre pupils and least on the best pupils - but the best pupils get most of the gold stars, naturally.

Now suppose an educational researcher observes the class, and notes the correlation between receiving a gold star, and increased effort. This is genuine causation. He then concludes that the teacher should give out more gold stars, regardless of whether the pupil does a good piece of work or not, and focus the stars on mediocre pupils. This change made, the gold stars no longer cause increased effort. The causation disappears! Changing the way the teacher hands out the gold stars changes the relationship between gold stars and effort. So although there was genuine causation in the original sample, there is no general causation, or causation in the sense we care about; we can't treat the gold stars as an exogenous variable.

See also the Lucas Critique.

Comment author: Decius 05 October 2012 02:38:09AM -1 points [-]

That's because you have cause and effect reversed: The extra effort causes the gold stars, not the other way around.

Comment author: Salemicus 05 October 2012 01:07:14PM 1 point [-]

No, the gold stars cause extra effort after they are given out. This is part of the hypothetical.

The pupils work harder after they are given a gold star because they see their good work is appreciated. But if the gold stars are given out willy-nilly, then the pupils no longer feel proud to get one, and so they lose their ability to make students work harder.

As Robert Lucas would put it, the relationship is not robust to changes in the policy regime.