MichaelBishop comments on Open Thread: February 2010, part 2 - Less Wrong

10 Post author: CronoDAS 16 February 2010 08:29AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (857)

You are viewing a single comment's thread.

Comment author: MichaelBishop 17 February 2010 07:11:26PM 0 points [-]

Have people previously tried/discussed this calibration diagnostic?

http://projectionpoint.com/

Comment author: Cyan 17 February 2010 07:13:28PM 1 point [-]

I think that link was posted earlier. I got an average score; don't recall the exact number. I was disappointed in my performance, but tsuyoku naritai.

Comment author: Nisan 22 February 2010 06:25:42PM 0 points [-]

Cool, I got a 90. This quiz actually tests your calibration on estimating the veracity of a very special class of statement, for which your prior is .5 and which is often deliberately tricky. To give a (made-up) example:

"Henry VI defeated Richard III at the Battle of Bosworth Field in 1485." (It was Henry VII, not Henry VI.)

This class of statement doesn't show up that often in real life.

Comment author: DanArmak 22 February 2010 06:36:03PM 1 point [-]

is often deliberately tricky

Then you're not really guessing at the truth of the statement. Instead you're guessing at the state of mind of the examiner, which involves a very different set of heuristics and biases.

Keep doing that and you may end up thinking, "maybe the correct answer is that he didn't defeat him because it was a Pyrrhic victory? Maybe Bosworth is spelled wrong? Maybe there's a dispute over the right year due to difficulties inherent in dating medieval events?"

Comment author: GuySrinivasan 22 February 2010 06:34:18PM 0 points [-]

for which your prior is .5

I took the quiz without assuming my prior was .5, and got a very very low score.

Comment author: AdeleneDawner 17 February 2010 11:24:13PM 0 points [-]

I just tried it. It may be noteworthy that I'm having a 'bad brain day' - low-grade headache with mild to moderate fogginess. I expected to do poorly, and wound up being pretty conservative with my guesses as a result of that. I got an 86.

Comment author: gwern 18 February 2010 09:18:56PM *  2 points [-]
Comment author: Alicorn 17 February 2010 07:24:45PM 0 points [-]

I hadn't seen it before. I just tried it and got a 63.