adsenanim comments on Self-fulfilling correlations - Less Wrong

103 Post author: PhilGoetz 26 August 2010 09:07PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nisan 27 August 2010 04:22:25AM 15 points [-]

Any new education method will show increases in student test scores if people believe it results in increases in student test scores, because only interested parents will sign up for that method.

For example, Freakonomics tells the story of high school students in Chicago who participated in a lottery for the chance to switch schools. The students who were reassigned to new schools were more likely to graduate; but the students who applied for the lottery but lost did just as well. The explanation given is that the students (or parents) who care about education will attempt to switch to a better school, but the "better" school won't confer an advantage.

Cullen, Jacob, and Levitt. "The Impact of School Choice on Student Outcomes: An Analysis of the Chicago Public Schools". J. Public Econ. 200?.

Cullen, Jacob, and Levitt. "The Effect of School Choice on Student Outcomes: Evidence from Randomized Lotteries". National Bureau of Economic Research working paper, 2003.

Comment author: adsenanim 29 August 2010 04:23:07AM *  2 points [-]

The following link lends credence to this line of thought:

http://www.management.wharton.upenn.edu/grant/Grant_JAP2008b_TaskSignificance.pdf

A note:

There was a study done regarding the cause and effect of employee relationships and how it affected job performance that gave as a result that employees performed better simply because of the attention given them, rather than the validity of any of the techniques introduced.

If anyone can provide a resource for that study, I'll vote you up because I am having trouble finding it.

If I remember correctly it is used in: O'Hair, Friedrich, Dixon 2008 Strategic Communication: In Business and the Professions, Pearson

Comment author: NancyLebovitz 29 August 2010 07:08:58AM 9 points [-]

It's called The Hawthorne Effect. At least in the Wikipedia article, no one considers the possibility that mere variation (less boredom) improves performance.

Comment author: adsenanim 31 August 2010 12:33:09AM 0 points [-]

Thanks NancyLebovitz, that’s the one.

| [...]no one considers the possibility that mere variation (less boredom) improves performance.

The reverse possibility may also be true, more boredom decreases performance and may also cause health problems.

Comment author: adsenanim 31 August 2010 04:59:31AM *  0 points [-]