= 27d567bc2d48d9f40e9ccc20ea370b15)
UnclGhost comments on Calibration Test with database of 150,000+ questions - LessWrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (31)
Great tool. Does the API you're using allow unanswerable questions to be flagged at all though? Just got one question that depended on an image that wasn't there, and another with no question body. Also, labeled axes on the graph might be nice for people who don't already know how calibration curves work and/or don't like unlabeled axes.
It does but only if you're hosting the API database on your own server. Which I will probably do sooner rather than later. I might implement a "skip" option for unanswerable questions. But selecting 0% does the same thing pretty much.