Great tool. Does the API you're using allow unanswerable questions to be flagged at all though? Just got one question that depended on an image that wasn't there, and another with no question body. Also, labeled axes on the graph might be nice for people who don't already know how calibration curves work and/or don't like unlabeled axes.
It does but only if you're hosting the API database on your own server. Which I will probably do sooner rather than later. I might implement a "skip" option for unanswerable questions. But selecting 0% does the same thing pretty much.
Hi all,
I put this calibration test together this morning. It pulls from a trivia API of over 150,000 questions so you should be able to take this many, many times before you start seeing repeats.
http://www.2pih.com/caltest.php
A few notes:
1. The questions are "Jeopardy" style questions so the wording may be strange, and some of them might be impossible to answer without further context. On these just assign 0% confidence.
2. As the questions are open-ended, there is no answer-checking mechanism. You have to be honest with yourself as to whether or not you got the right answer. Because what would be the point of cheating at a calibration test?
I can't think of anything else. Please let me know if there are any features you would want to see added, or if there are any bugs, issues, etc.
**EDIT**
As per suggestion I have moved this to the main section. Here are the changes I'll be making soon:
Here are changes I'll make eventually:
Here are the changes that are done: