Eliezer_Yudkowsky comments on Causal Diagrams and Causal Models - Less Wrong

61 Post author: Eliezer_Yudkowsky 12 October 2012 09:49PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (274)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 12 October 2012 10:05:37PM 1 point [-]

How can I send this to people I know who will ask why he's using two time-variant variables as single acyclic nodes

This is not intended for readers who already know that much about causal models, btw, it's a very very very basic intro.

Comment author: EricHerboso 13 October 2012 02:55:00AM 6 points [-]

I'm torn. On the one hand, using the method to explain something the reader probably was not previously aware of is an awesome technique that I truly appreciate. Yet Vaniver's point that controversial opinions should not be unnecessarily put into introductory sequence posts makes sense. It might turn off readers who would otherwise learn from the text, like nyan sandwich.

In my opinion, the best fix would be to steelman the argument as much as possible. Call it the physics diet, not the virtue-theory of metabolism. Add in an extra few sentences that really buff up the basics of the physics diet argument. And, at the end, include a note explaining why the physics diet doesn't work (appetite increases as exercise increases).

Comment author: Vaniver 13 October 2012 03:58:20AM *  10 points [-]

The point Eliezer is addressing is the one that RichardKennaway brought up separately. Causal models can still function with feedback (in Causality, Pearl works through an economic model where price and quantity both cause each other, and have their own independent causes), but it's a bit more bothersome.

A model where the three are one-time events- like, say, whether a person has a particular gene, whether or not they were breastfed, and their height as an adult- won't have the problem of being cyclic, but will have the pedagogical problem that the causation is obvious from the timing of the events.

One could have, say, the weather witch's prediction of whether or not there will be rain, whether or not you brought an umbrella with you, and whether or not it rained. Aside from learning, this will be an acyclic system that has a number of plausible underlying causal diagrams (with the presence of the witch making the example clearly fictional and muddying our causal intuitions, so we can only rely on the math).

In my opinion, the best fix would be to steelman the argument as much as possible.

The concept of inferential distance suggests to me that posts should try and make their pathways as short and straight as possible. Why write a double-length post that explains both causal models and metabolism, when you could write a single-length post that explains only causal models? (And, if metabolism takes longer to discuss than causal models, the post will mostly be about the illustrative detour, not the concept itself!)

Comment author: MC_Escherichia 14 October 2012 08:55:12PM 2 points [-]

won't have the problem of being acyclic

Should that be "cyclic"? I take it from Richard's post that "acyclic" is what we want.

Comment author: Vaniver 15 October 2012 02:44:59AM 0 points [-]

Yes, it should. Thanks for catching the typo!

Comment author: EricHerboso 13 October 2012 07:19:53PM 2 points [-]

The concept of inferential distance suggests to me that posts should try and make their pathways as short and straight as possible. Why write a double-length post that explains both causal models and metabolism, when you could write a single-length post that explains only causal models? (And, if metabolism takes longer to discuss than causal models, the post will mostly be about the illustrative detour, not the concept itself!)

You've convinced me. I now agree that EY should go back and edit the post to use a different more conventional example.

Comment author: [deleted] 13 October 2012 08:13:09AM *  3 points [-]

In my opinion, the best fix would be to steelman the argument as much as possible. Call it the physics diet, not the virtue-theory of metabolism.

“Physics diet” and “virtue-theory of metabolism” are not steelman and strawman of each other; they are quite different things. Proponents of the physics diet (e.g. John Walker) do not say that if you want to lose weight you should exercise more -- they say you should eat less. EDIT: the strawman of this would be the theory that “excessive eating actually causes weight gain due to divine punishment for the sin of gluttony” (inspired by Yvain's comment).

Seriously; that was intended to be an example. What's it matter whether the nodes are labelled “exercise/overweight/internet” or “foo/bar/baz”? (But yeah, Footnote 1 doesn't belong there, and Footnote 3 might mention eating.)