Heka comments on Fermi Estimates - Less Wrong

51 Post author: lukeprog 11 April 2013 05:52PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (104)

You are viewing a single comment's thread. Show more comments above.

Comment author: Morendil 06 April 2013 11:12:03PM *  6 points [-]

Tip: frame your estimates in terms of intervals with confidence levels, i.e. "90% probability that the answer is within <low end> and <high end>". Try to work out both a 90% and a 50% interval.

I've found interval estimates to be much more useful than point estimates, and they combine very well with Fermi techniques if you keep track of how much rounding you've introduced overall.

In addition, you can compute a Brier score when/if you find out the correct answer, which gives you a target for improvement.

Comment author: Heka 27 April 2013 07:04:36PM *  0 points [-]

Douglas W. Hubbard has a book titled How to Measure Anything where he states that half a day of exercising confidence interval calibration makes most people nearly perfectly calibrated. As you noted and as is said here, that method fits nicely with Fermi estimates.

This combination seems to have a great ratio between training time and usefulness.