torekp comments on [Retracted] Simpson's paradox strikes again: there is no great stagnation? - Less Wrong

30 Post author: CarlShulman 30 July 2012 05:55PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (51)

You are viewing a single comment's thread.

Comment author: torekp 30 July 2012 10:22:44PM 0 points [-]

One heuristic I try to use in making sense of claims about broken-down data is to zoom out to the big picture for a "reality check." [/tongueincheek] Reality doesn't play favorites with big versus small pictures.

Comment author: CarlShulman 30 July 2012 10:45:25PM 2 points [-]

That isn't a bad heuristic either! However in practice the aggregate claims about scores are often used to make an argument relying upon internal homogeneity, and I don't see the corresponding "scores are up among all groups so aggregate scores must be higher" often, which would require more information and space.