You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Jan_Rzymkowski comments on [LINK] The errors, insights and lessons of famous AI predictions: preprint - Less Wrong Discussion

5 Post author: Stuart_Armstrong 17 June 2014 02:32PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (14)

You are viewing a single comment's thread.

Comment author: Jan_Rzymkowski 17 June 2014 05:33:35PM 1 point [-]

Isn't this article highly susceptible to hindsight bias? For example, the reason authors analyse Dreyfus's prediction is that, he was somewhat right. If he weren't, authors woudn't include that data-point. Therefore it skewes the data, even if it is not their intention.

It's hard to take valuable assessements from the text, when it would be naturally prone to highlight mistakes of the experts and correct predictions by laymen.

Comment author: Stuart_Armstrong 17 June 2014 07:39:35PM 1 point [-]

The Dartmouth conference was very wrong, and is also famous. Not sure hindsight points in a particular direction.

Comment author: Jan_Rzymkowski 17 June 2014 08:32:49PM 3 points [-]

Now I think I shouldn't mention hindsight bias, it doesn't really fit here. I'm just saying that some events would be more probably famous, like: a) laymen posing extraordinary claim and ending up being right b) group of experts being spectacularly wrong

If some group of experts met in 1960s and pose very cautious claims, chances are small that it would end up being widely known. And ending up in above paper. Analysing famous predictions is bound to end up with many overconfident predictions - they're just more flashy. But it doesn't yet mean most of predictions are overconfident.

Comment author: Stuart_Armstrong 18 June 2014 07:18:18AM 2 points [-]

Very valid point. But overconfidence is almost universal, and estimates where selection bias isn't an issue (duck as polls at conferences) seem to show it as well.