Morendil comments on Raising the forecasting waterline (part 1) - LessWrong

33 Post author: Morendil 09 October 2012 03:49PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (108)

You are viewing a single comment's thread. Show more comments above.

Comment author: thomblake 09 October 2012 08:37:09PM 5 points [-]

Talking about increments of 5% runs counter to my intuitions regarding good thinking about probability estimates. For most purposes, the difference between 90% and 95% is significantly larger than the difference between 50% and 55%. Think in logs.

Comment author: Morendil 09 October 2012 09:30:19PM 4 points [-]

Yes, near the extremes it makes a difference - but we're using a Brier scoring rule, averaged over all days a forecast is open. That makes thinking in logs less important - 99% isn't much worse than 100% on errors. I'll discuss that in pt.2 under 'loss function'.

Comment author: thomblake 10 October 2012 01:49:12PM 0 points [-]

I'll discuss that in pt.2 under 'loss function'.

Hooray!