falenas108 comments on Calibration Test with database of 150,000+ questions - LessWrong

37 Post author: Nanashi 14 March 2015 11:22AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (31)

You are viewing a single comment's thread. Show more comments above.

Comment author: falenas108 14 March 2015 05:47:17PM 9 points [-]

My favorite calibration tools have been one where there was a numerical answer and you had to express a 50% confidence interval, or 90% confidence interval.

Like, a question would be how many stairs are there in the Statue of Liberty? And my 50% interval would be 400-1000, and my 90% interval would be 200-5000.

Looking up the answer it was 354, and I would mark my 50% as wrong and my 90% as right.