You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

shminux comments on AI prediction case study 1: The original Dartmouth Conference - Less Wrong Discussion

7 Post author: Stuart_Armstrong 11 March 2013 06:09PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (13)

You are viewing a single comment's thread.

Comment author: shminux 11 March 2013 09:08:31PM *  7 points [-]

Just wanted to note that the case under consideration was quite unlike your garden-variety predictions, but more like an industrial project estimate. It gave quite concrete scope, effort and schedule estimates, something rarely done by long-term forecasters. So the relevant reference class would be ambitious scientific and industrial projects. One example is the failed Fifth Generation Computer Systems project. Another was the Manhattan project (not sure if there are circa 1941 estimates evailable for it). Not even the Moon landing project was in the same reference class, because it was clearly "just" an issue of (extremely massive) scaling up, rather than solving unknown problems. Not sure about the controlled nuclear fusion, maybe there are some predictions from 1950s available. Consider looking into Grand Challenges for further examples of the same reference class. Some other projects which come to mind: Feynman gives an account of Wheeler promising to present quantized gravity for the next seminar (because EM was just successfully quantized and gravity is just another field theory, with a spin-2 carrier instead of a spin-1 one).

By the way, there are quite specific reasons one should have, in retrospect, expected a very low probability of the summer AI project to succeed, common to most estimates massaging the data to fit the deadlines and the available budget, rather than working upwards from the scope and risk analysis.

Comment author: satt 12 March 2013 10:41:02PM 1 point [-]

Not sure about the controlled nuclear fusion, maybe there are some predictions from 1950s available.

Good thought.

In 1958, a Nobel prize–winning scientist from the United Kingdom named Sir John Cockcroft gathered the nation's media to announce that he and his research team had demonstrated controlled nuclear fusion in a giant machine nicknamed Zeta. [...] Commercially generated fusion power was two decades away, he predicted. Just months later Cockcroft was forced to admit that his observation of nuclear fusion and subsequent claims were an unfortunate mistake.

—  Tyler Hamilton, Mad Like Tesla, p. 32

Comment author: Stuart_Armstrong 12 March 2013 11:02:23AM 1 point [-]

Thanks! I like that reference class.