You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

jimrandomh comments on Controls and bias - Less Wrong Discussion

2 Post author: a363 11 April 2011 04:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread.

Comment author: jimrandomh 11 April 2011 05:19:40PM *  6 points [-]

The goal here is to distinguish between these three causal graphs:

(A) Pure placebo
X --> belief
/
|
v
Effect
(B) Direct effect
X --> belief
\
|
v
Effect
(C) Both direct and placebo effects
X --> belief
\ /
| |
v v
Effect

Unfortunately, you cannot possibly distinguish these if you only measure X and the effect, without either observing or controlling peoples' belief (such as by giving them placebos so they all believe they're getting X, or asking them survey questions about whether they think X will work). There are some theorems about which causal graphs can and can't be distinguished from which types of observations in Pearl's book Causality.