Miller comments on Machine learning and unintended consequences - Less Wrong

15 Post author: lukeprog 23 September 2011 02:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (24)

You are viewing a single comment's thread.

Comment author: Miller 23 September 2011 04:25:23AM 0 points [-]

I'm reminded of one of your early naively breathless articles here on the value of mid-80s and prior expert systems.

Comment author: Douglas_Knight 23 September 2011 01:49:50PM 6 points [-]

Why don't you write a post on how it is naive? Do you actually know something about practical application of these methods?

Yes, if experts say that they use quantifiable data X, Y, and Z to predict outcomes, that simple algorithms beat them on only that data might not be important if the experts really use other data. But there is lots of evidence saying that experts are terrible at non-quantifiable data, such as thinking interviews are useful in hiring. Tetlock finds that ecologically valid use of these trivial models beats experts in politics.

Comment author: Miller 23 September 2011 06:16:44AM 3 points [-]

this one:

http://lesswrong.com/lw/3gv/statistical_prediction_rules_outperform_expert/

When based on the same evidence, the predictions of SPRs are at least as reliable as, and are typically more reliable than, the predictions of human experts for problems of social prediction.

Hmm yes, 'same evidence'.