Eugine_Nier comments on 1001 PredictionBook Nights - Less Wrong

51 Post author: gwern 08 October 2011 04:04PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (49)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 12 October 2011 03:03:19PM *  3 points [-]

You don't have very many predictions judged, so I'm not sure how reliable your worry is - only 8-11 predictions for each decile seems quite possible to just get lucky. Assuming that's not the case, you could try mechanically bumping up every prediction by 10% and see what happens.

Comment author: Eugine_Nier 12 October 2011 11:24:43PM 2 points [-]

Also I notice there are many sets of predictions of the the form X will happen in 1 month/2 months/1 year/... with a separate prediction for each time period. How are these scored? Since these types of predictions are highly correlated scoring them individually can cause people to appear over or under confident.

Comment author: gwern 13 October 2011 01:50:12AM 1 point [-]

Is there any reason to think the sets won't balance out eventually?

Comment author: Eugine_Nier 15 October 2011 02:47:11AM 3 points [-]

The will, for very large values of eventually.