You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

prase comments on An Anchoring Experiment - Less Wrong Discussion

12 Post author: prase 01 April 2011 02:19PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (83)

You are viewing a single comment's thread. Show more comments above.

Comment author: prase 01 April 2011 04:03:28PM 1 point [-]

Thanks for feedback. I know that it is difficult to avoid seeing the comments of others. The problem with e-mail is that it is marginally less convenient to do, and I was afraid that people would have not enough motivation to respond.

As for hiding the instructions, I don't see a strong reason. I suppose priming is a strong enough effect to persist even if people know they are being tested for it.

Comment author: rhollerith_dot_com 01 April 2011 04:45:23PM *  1 point [-]

As for hiding the instructions, I don't see a strong reason.

If the coin flip puts me in group II, does not my inadvertently seeing the question intended for group I (e.g., "Is the population of the Central African Republic lower or greater than 20 million?") de facto reassign me to group I? In other words, after I had been exposed to the anchor (20 million) would not my continued participation in the control group have undermined the purpose of the control group?

ADDED.

I suppose priming is a strong enough effect to persist even if people know they are being tested for it.

I tend to agree, but that's not it.

Comment author: Pavitra 01 April 2011 11:53:04PM 0 points [-]

after I had been exposed to the anchor, would not my continued participation in the control group have undermined the purpose of the control group?

Agreed. It would have been better to always answer the group-II question first, whichever one you were assigned to. (That is, switch the part 1 group II question with the part 2 group I question.)

Comment author: prase 01 April 2011 04:52:12PM *  0 points [-]

I have misunderstood you and thought you suggest that I hide parts of the original post.

I have expected that people follow on the links in the bottom of the post. If you click on the group II question link, you don't see the group I question. Of course, if you scroll down, you will see it, but therefore I have warned against reading the comments.

Comment author: rwallace 01 April 2011 06:30:19PM 0 points [-]

As a positive data point, the instructions worked for me, and I think this is an interesting and well thought-out experiment - the method isn't perfectly watertight, but that has to be balanced against making it easy and attractive for people to participate, as well as against the cost (in your time and energy) of setting it up. I think you struck a good balance.