You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

buybuydandavis comments on On the Importance of Systematic Biases in Science - Less Wrong Discussion

26 Post author: gwern 20 January 2013 09:39PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (14)

You are viewing a single comment's thread.

Comment author: buybuydandavis 21 January 2013 12:57:49PM *  9 points [-]

The absurdity of the conclusion tells us rather forcefully that the rule is not always valid, even when the separate data values are causally independent; it requires them to be logically independent. In this case, we know that the vast majority of the inhabitants of China have never seen the Emperor; yet they have been discussing the Emperor among themselves and some kind of mental image of him has evolved as folklore. Then knowledge of the answer given by one does tell us something about the answer likely to be given by another, so they are not logically independent

Maybe it's just that it's late, but what he's saying in this quote isn't making sense to me.

To demonstrate the validity of the italicized comment, he should give an example where the data values are causally independent, but not logically independent. But the example he gives, of shared conversations and folklore, strike me as not causally independent at all, so while it supports the basic point about systematic error, it doesn't support this particular comment.

Comment author: syllogism 22 January 2013 11:06:55PM 5 points [-]

What's more, that's not even the problem. Let's say you ask the Chinese people to estimate the height of the king of Samoa. Here they've never talked of him, and know nothing about him other than that he's human. You still can't magic the information out of repeated estimation.

Comment author: jsalvatier 21 January 2013 03:56:51PM 2 points [-]

I was confused about that too. I think he must mean conditionally causally independent, but then he has to say conditional on what.

Comment author: BlazeOrangeDeer 22 January 2013 05:50:13PM 0 points [-]

Maybe he means that each interview of a citizen is causally independent, since interviewing one of them won't causally affect the answer of another.

Comment author: buybuydandavis 22 January 2013 10:57:27PM 0 points [-]

You could analyze the interview as adding a perturbation to people's "pre" responses, and per jsalvatier's comment, say that those perturbations are conditionally independent, as conditioned by the pre responses.

But it's the independence of the response that matters, and it's not independent of the stories and folklore.

Maybe my confusion can be clarified by showing a case where you have logical dependence but causal independence. I'm not seeing it. Jaynes uses inferential reasoning using backward in time urn draws as his go to example for causal independence but logical dependence. But that still seems a case where there is shared causal dependence on the number and kinds of balls in the urn originally.