You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

lukeprog comments on AI Risk and Opportunity: Humanity's Efforts So Far - Less Wrong Discussion

28 Post author: lukeprog 21 March 2012 02:49AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread.

Comment author: lukeprog 31 March 2012 02:18:56PM 0 points [-]

A passage from McCulloch (1952) that nearly suggests Good's intelligence explosion of 1959:

Von Neumann has already made... a most fascinating proposal... It is natural for us to suppose that if a machine of a given complexity makes another machine, that second machine cannot require any greater specification than was required for the first machine, and will in general be simpler. All our experience with simple machines has been of that kind. But when the complexity of a machine is sufficiently great, this limitation disappears. A generalized Turing machine, coupled with an assembling machine and a duplicator of its tape, could pick up parts from its environment, assemble a machine like itself and its assembling machine and its duplicator of program, put the program into it, and cut loose a new machine like itself... [And] as it is inherently capable of learning, it could make other machines better adapted to its environment or changing as the environment changed.