= 27d567bc2d48d9f40e9ccc20ea370b15)
Nanashi comments on Calibration Test with database of 150,000+ questions - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (31)
Well, I'm getting a reasonably exciting calibration curve with lots of ups and downs. Cool!
Bug: when I click "Display Calibration Curve" for a second time, the graph is displayed in a larger size. (Doing this sufficiently many times crashed Chrome.) Refreshing the page fixes this behavior.
Feature request: I would like to be able to see if my 50% correctness for 30% confidence is getting 1 out of 2 questions right or 5 out of 10. (Error bars of some sort would also work.)
Good idea. I don't think the charts API I'm using will let me do error bars but a good alternative would be a secondary chart that's a bar graph of right vs total questions for each bucket. This would also give a good visual representation of the frequency with which you use various confidence levels.