gjm comments on Shut Up And Guess - Less Wrong

79 Post author: Yvain 21 July 2009 04:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (105)

You are viewing a single comment's thread. Show more comments above.

Comment author: gjm 19 January 2016 11:26:06AM 0 points [-]

Depends what you do with the other 99.99% and the other three answers, I assume.

In a two-answer scenario, if I'm understanding bill's version of the log scoring rule correctly, giving p=0.9999 to the right answer and p=0.0001 to the wrong answer should get you [log(0.9999)-log(1/2)]/log(2) ~= 0.99986 points. With four answers, giving p=0.9997 to the right answer and p=0.0001 to each of three wrong answers should get you [log(0.9997)-log(1/4)]/log(4) ~= 0.99978 points.