Larks comments on Open thread, July 16-22, 2013 - Less Wrong

13 Post author: David_Gerard 15 July 2013 08:13PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (297)

You are viewing a single comment's thread.

Comment author: Larks 20 July 2013 07:51:42PM 2 points [-]

The Good Judgement Project is using the Brier score to rate participants forecasts. This is not LW's usual preferred scoring system (negative log odds); Brier is much more forgiving of incorrect assignments of 0 probability. I checked the maths, and you're expected score is still minimised by honestly reporting your subjective probabilities, but are there any more subtle ways to game the system?

Comment author: gwern 20 July 2013 08:53:29PM 0 points [-]

Perhaps it encourages one to make long-shot bets? If you aren't penalized too badly for P=0 events happening, this suggests that short-selling contracts at ~1% may be better than it looks.