John_Maxwell_IV comments on 2014 Survey Results - Less Wrong

87 Post author: Yvain 05 January 2015 07:36PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (279)

You are viewing a single comment's thread. Show more comments above.

Comment author: John_Maxwell_IV 06 January 2015 11:24:51AM 0 points [-]

Have you done calibration training? Do you recommend it? I think I remember someone from CFAR saying that it was kind of a niche skill, and to my knowledge it hasn't been incorporated in to their curriculum (although Andrew Critch created a calibration android app?)

Comment author: Vaniver 06 January 2015 04:53:16PM 0 points [-]

I've done a moderate amount of training. I think that the credence game is fun enough to put an hour or two into, but I think the claim that it's worth putting serious effort into rests on the claim that it transfers (or that probabilistic judgments are common enough in your professional field that it makes sense to train those sorts of judgments).

Comment author: John_Maxwell_IV 06 January 2015 10:07:40PM *  1 point [-]

CFAR calibration games

I tried the game for a while... many of the questions are pretty hard IMO (especially the "which of these top-10 ranked things was ranked higher" ones), which makes it a bit difficult to learn to differentiate easy & hard questions.

Other calibration quizzes

Comment author: Vaniver 06 January 2015 10:19:58PM 2 points [-]

many of the questions are pretty hard IMO

I think that's necessary? You want to have questions you can answer at every credence band between 99% and 50%, and that implies questions you're only 60% sure of the answer of.