MichaelHoward comments on Information cascades - Less Wrong

48 Post author: Johnicholas 06 March 2009 04:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (32)

You are viewing a single comment's thread. Show more comments above.

Comment author: MichaelHoward 08 March 2009 05:34:08PM *  5 points [-]

If we were serious about this, I'd suggest a double-blind experiment where for a randomly selected minority of posts or comments, half of us see a score higher than the real score and half see a lower score. Something like +/- <1 + 0.1 * real score> per <hours since posted squared>, so they still look believable and change as expected as the user makes a vote. We then see how this affected voting, and whether being influenced by scoring correlates to other factors. While it's on, users would be asked not to discuss specific scores.

Comment author: anonym 08 March 2009 10:09:53PM 3 points [-]

Great idea. One potential problem though for these sorts of experiments is that knowledge (or reasonable suspicion) of the experiments would alter users' behavior.

Comment author: MichaelHoward 08 March 2009 11:32:56PM *  2 points [-]

Yes, but I'm hoping using a randomly selected minority posts or comments would help, and I'd expect our estimations as to which posts have been raised or lowered would be interestingly inaccurate. Maybe we could submit our guesses along with the probability we assign to each guess, then the calibration test results could be posted... :-)