wedrifid comments on Causal Diagrams and Causal Models - Less Wrong

61 Post author: Eliezer_Yudkowsky 12 October 2012 09:49PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (274)

You are viewing a single comment's thread.

Comment author: wedrifid 13 October 2012 06:39:47AM 31 points [-]

The statisticians who discovered causality were trying to find a way to distinguish, within survey data, the direction of cause and effect - whether, as common sense would have it, more obese people exercise less because they find physical activity less rewarding; or whether, as in the virtue theory of metabolism, lack of exercise actually causes weight gain due to divine punishment for the sin of sloth.

I recommend that Eliezer edit this post to remove this kind of provocation. The nature of the actual rationality message in this post is such that people are likely to link to it in the future (indeed, I found it via an external link myself). It even seems like something that may be intended to be part of a sequence. As it stands I expect many future references to be derailed and also expect to see this crop up prominently in lists of reasons to not take Eliezer's blog posts seriously. And, frankly, this reason would be a heck of a lot better than most others that are usually provided by detractors.

Comment author: loup-vaillant 14 October 2012 12:09:09AM *  5 points [-]

Maybe the "mainstream status" section should be placed at the top? It would signal right at the top that this post is backed by proper authority.

In addition to the provocation you mention, openly bashing mainstream philosophy in the fourth paragraph doesn't help. If you add a possible reputation of holding unsubstantiated whacky beliefs, well…

That said, I was quite surprised by the number of comments about this issue. I for one didn't see any problem with this post.

When I read "divine punishment for the sin of sloth", I just smiled at the supernatural explanation, knowing that Eliezer of course knows the virtue theory of metabolism have a perfectly natural (and reasonable sounding) explanation. Actually, it didn't even touched my model of his probability distribution of the veracity of the "virtue" theory —nor my own. After having read so much of his writings, I just can't believe he rules such a hypothesis out a priori. Remember reductionism. And my model of him definitely does not expect to influence LessWrong readers with an unsubstantiated mockery.

Also, this:

And lo, merely by eyeballing this data -

(which is totally made up, so don't go actually believing the conclusion I'm about to draw)

made clear he wasn't discussing the object at all. It was then easier for me to put myself in a position of total uncertainty regarding the causal model implied by this "data". The same way my HPMOR anticipations are no longer build on cannon —Bellatrix could really be innocent, for al I know.

But this is me assuming total good faith from Eliezer. I totally forgot that many people in fact do not assume good faith.

Comment author: Caspian 14 October 2012 04:33:37AM 2 points [-]

I mostly liked the post. In Pearl's book, the example of whether smoking causes cancer worked pretty well for me despite being potentially controversial, and was more engaging for being on a controversial topic. Part of that is he kept his example fairly cleanly hypothetical. Eliezer's "I didn't really start believing that the virtue theory of metabolism was wrong" in a footnote, and "as common sense would have it" in the main text, both were suggesting it was about the real world. I think in Pearl's example, he may have even made his hypothetical data give the opposite result to the real world.

This post I also thought was more engaging due to the controversial topic, so if you can keep that while reducing the "mind-killer politics" potential I'd encourage that.

I was fine with the model he was falsifying being simple and easily disproved - that's great for an example.

I'm kind of confused and skeptical at the bit at the end: we've ruled out all the models except one. From Pearl's book I'd somehow picked up that we need to make some causal assumption, statistical data wasn't enough to get all the way from ignorance to knowing the causal model.

Is assuming "causation would imply correlation" and "the model will have only these three variables" enough in this case?

Comment author: Vaniver 15 October 2012 02:20:54AM *  3 points [-]

I think in Pearl's example, he may have even made his hypothetical data give the opposite result to the real world.

He introduces a "hypothetical data set," works through the math, then follows the conclusion that tar deposits protect against cancer with this paragraph:

The data in Table 3.1 are obviously unrealistic and were deliberately crafted so as to support the genotype theory. However, the purpose of this exercise was to demonstrate how reasonable qualitative assumptions about the workings of mechanisms, coupled with nonexperimental data, can produce precise quantitative assessments of causal effects. In reality, we would expect observational studies involving mediating variables to refute the genotype theory by showing, for example, that the mediating consequences of smoking (such as tar deposits) tend to increase, not decrease, the risk of cancer in smokers and nonsmokers alike. The estimand of (3.29) could then be used for quantifying the causal effect of smoking on cancer.

When I read it, I remember being mildly bothered by the example (why not have a clearly fictional example to match clearly fictional data, or find an actual study and use the real data as an example?) but mostly mollified by his extended disclaimer.

(I feel like pointing out, as another example, the decision analysis class that I took, which had a central example which was repeated and extended throughout the semester. The professor was an active consultant, and could have drawn on a wealth of examples in, say, petroleum exploration. But the example was a girl choosing a location for a party, subject to uncertain weather. Why that? Because it was obviously a toy example. If they tried to use a petroleum example for petroleum engineers, the petroleum engineers would be rightly suspicious of any simplified model put in front of them- "you mean this procedure only takes into account two things!?"- and any accurate model would be far too complicated to teach the methodology. An obviously toy example taught the process, and then once they understood the process, they were willing to apply it to more complicated situations- which, of course, needed much more complicated models.)

Comment author: loup-vaillant 14 October 2012 09:00:51AM 0 points [-]

There may also be the assumption that the graph is acyclic.

Some causal models, while not flat out falsified by the data, are rendered less probable by the fact the data happens to fit more precise (less connected) causal graphs. A fully connected graph is impossible to falsify, for instance (it can explain any data).

Among all graphs that explain the fictional data here, there is only one that has only two edges. That's the most probable one.

Comment author: Jonathan_Graehl 13 October 2012 07:24:27PM 0 points [-]

But not quite as damaging as rationalist case study: the ideal child-bearing age turns out to be 13 years old (advances in modern medicine, you know).

Comment author: ThrustVectoring 13 October 2012 11:11:29PM 10 points [-]

Ideal for what, exactly? Churning out the most babies in the shortest amount of time? Having a happy and well-adjusted populace? Having a long life?

Ideal is a very loaded word and using it implies that there's an obvious utility function, when there often isn't.

Comment author: Jonathan_Graehl 14 October 2012 09:58:44PM 1 point [-]

In any case, 13 is too young in many cases. I was being facetious.