You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

IlyaShpitser comments on The Danger of Invisible Problems - Less Wrong Discussion

14 Post author: Snorri 06 November 2014 10:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (55)

You are viewing a single comment's thread. Show more comments above.

Comment author: IlyaShpitser 07 November 2014 03:12:03PM *  6 points [-]

Indeed. They call this "effect modification" in epi. I guess in some sense, this is just another guise for the curse of dimensionality in the context of determining causal effects. Lots of covariates might be relevant for why [X] helps you, but trials aren't very large, and simple regression models people use probably aren't right very often. So it's hard to establish if E[Y | do(x), C] - E[Y | do(placebo), C] is appreciably different from 0 for a sufficiently multidimensional C.


edit: In case it is not clear, p(A | do(B=b), C) is defined to be p(A, C | do(B=b)) / p(C | do(B=b)) (under appropriate assumptions that preclude dividing by zero). This is one of the reasons I don't like the do(.) notation so much. In counterfactual notation, we can make a distinction about whether C is under the interventional regime or not, that is in general p(A(b) | C(b)) is not equal to p(A(b) | C) (but it is for any pretreatment covariate C, because then p(C | do(B=b)) = p(C(b)) = p(C). That is, the future cannot affect the past.