gwern comments on 1001 PredictionBook Nights - Less Wrong

51 Post author: gwern 08 October 2011 04:04PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (49)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eugine_Nier 11 October 2011 04:21:01AM *  5 points [-]

Since the study focused on the period around the 2008 elections, which the Democrats won on nearly all levels, and since most pundits tend to be biased towards believing that what they wish would happen will happen, it's not surprising that liberals' predictions did better and some conservatives scored worse than random. I suspect we'd see the trend go the other way for say predictions about the 2010 midterms. The fundamental problem is that the predictions weren't independent.

Comment author: Will_Sawin 11 October 2011 04:41:33AM 2 points [-]

In particular, one should be skeptical of having lots of people who consistently do worse than average.

I think, though, that it would, in fact, be worthwhile to do the analysis combining 2008 and 2010. I think Paul Krugman had already started panicking by then.

More interesting might be to see how much data it takes for prediction markets to beat most/all pundits.

Comment author: gwern 11 October 2011 08:13:35PM 4 points [-]

I would expect Krugman to suffer penalties over the last few years; I don't read him very much, but he seems to have gotten much more partisan and inaccurate as time passes.