ESRogs comments on Book: AKA Shakespeare (an extended Bayesian investigation) - Less Wrong

-1 Post author: matt 28 June 2013 04:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (13)

You are viewing a single comment's thread. Show more comments above.

Comment author: ESRogs 28 June 2013 07:12:04PM 1 point [-]

a claim to actually being good at this sort of thing

If I'm reading the chart on that page correctly, Gwern is extremely well calibrated. Is the accuracy row for each confidence column telling us what fraction of predictions Gwern assigned a given confidence to have been right? He's got 50% - 44%, 60% - 64%, 70% - 71%, 80% - 83%, 90% - 92%, and 100% - 96%. That's incredible!

Comment author: gwern 28 June 2013 07:35:07PM 2 points [-]

Is the accuracy row for each confidence column telling us what fraction of predictions Gwern assigned a given confidence to have been right?

Yes, something like that. I forget the exact details of how it bins.

That's incredible!

Thank you. That's years of practice and some useful heuristics at work there.