You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

orthonormal comments on Meta analysis of Writing Therapy - Less Wrong Discussion

13 Post author: jsalvatier 01 January 2012 02:02AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread.

Comment author: orthonormal 01 January 2012 06:49:42PM 0 points [-]

Here's another study that shows significant effects for a particular type of writing therapy. I'm going to use this in my classes next semester.

Comment author: buybuydandavis 01 January 2012 11:48:41PM 0 points [-]

This study seems rather peculiar.

Note that they weren't asked to write about their values with respect to science. Perhaps the context increased the likelihood they did so, or perhaps there was a place dependence to the effect - the feelings of value got anchored to the location you felt them in?

Otherwise, I'd expect to see the result generalize far and wide to their lives. On the other hand, that a 15 minute writing assignment would have such far ranging effects in a person's life seems rather unlikely to me. That it would have such a wide ranging effect in that one class seems miraculous in itself.

Hence, I find it all rather peculiar.

Notice how the men did significantly worse on their exam scores after values affirmation. What's the explanation for that?

And "stereotype threat" just seems like a non sequitur here. How is that in any way related to the writing task? I see in the abstract that they found that "Benefits were strongest for women who tended to endorse the stereotype that men do better than women in physics."

And the "control" is as much an experiment as the "treatment". Why shouldn't we conclude that the "control" had a large negative effect on women, and particularly women who believed the stereotype (and data) that men are better at math?

Maybe the women who believed the data that men were better at math showed the greatest jump because they believed in data, and so had greater aptitude thereby? Maybe those women were just more impressionable to the value of others, and so disheartened by contemplating things they didn't value that other people did.

The raw data seems odd, and the interpretation even more dubious. Just peculiar all the way around. It certainly warrants further study, and I'd particularly like to see it controlled for each individual with a test of their aptitude/achievement going into the class.

Comment author: orthonormal 04 January 2012 03:26:31AM 1 point [-]

Notice how the men did significantly worse on their exam scores after values affirmation. What's the explanation for that?

That difference looks to me to be within the margin of error.

Maybe the women who believed the data that men were better at math showed the greatest jump because they believed in data, and so had greater aptitude thereby?

Among the stereotyped group that most believed the stereotype, there was the greatest divergence between the effects of the two writing exercise. Your suggestion should predict that all of the stereotype-believing group would improve equally. Also, "they believed in data, and so had greater aptitude thereby"? It would be a lot less embarrassing if you just figured out and stated your true rejection of this study.

Comment author: orthonormal 03 January 2012 10:12:09PM 1 point [-]

perhaps there was a place dependence to the effect - the feelings of value got anchored to the location you felt them in

I think that's the mechanism the authors believe in; the place or context of the science classroom becomes less intimidating when the first thing they did in the semester is prime themselves with confidence.

You can defy the data if you like, but it seems pretty plausible to me.

Comment author: buybuydandavis 04 January 2012 02:32:57AM 0 points [-]

I think that's the mechanism the authors believe in; the place or context of the science classroom becomes less intimidating when the first thing they did in the semester is prime themselves with confidence.

What did they write that gave you that impression?