XiXiDu comments on Rationality, Singularity, Method, and the Mainstream - Less Wrong

38 Post author: Mitchell_Porter 22 March 2011 12:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (35)

You are viewing a single comment's thread.

Comment author: XiXiDu 22 March 2011 12:30:45PM 1 point [-]

...specific ideas Eliezer has come up with over the years - the concept of seed AI...

I don't want to nitpick on this again but when exactly did he come up with that concept? Because it is mentioned in Karl Schroeder's Ventus (Tor Books, 2000.) ISBN 978-0312871970.

Here are a few quotes from Ventus:

Look at it this way. Once long ago two kinds of work converged. We'd figured out how to make machines that could make more machines. And we'd figured out how to get machines to... not exactly think, but do something very much like it. So one day some people built a machine which knew how to build a machine smarter than itself. That built another, and that another, and soon they were building stuff the men who made the first machine didn't even recognize.

[...]

And, some of the mechal things kept developing, with tremendous speed, and became more subtle than life. Smarter than humans. Conscious of more. And, sometimes, more ambitious. We had little choice but to label them gods after we saw what they could do--namely, anything.

[...]

They did not command the wealth of nations, these researchers. Although their grants amounted to millions of Euros, they could never have funded a deep-space mission on their own, nor could they have built the giant machineries they conceived of. In order to achieve their dream, they built their prototypes only in computer simulation, and paid to have a commercial power satellite boost the Wind seeds to a fraction of light speed. [...] no one expected the Winds to bloom and grow the way they ultimately did.

It is further explained that the Winds were designed to evolve on their own so they are not mere puppets of human intentions but possess their own intrinsic architecture.

In other places in the book it is explained how humans did not create their AI Gods but that they evolved themselves from seeds designed by humans.

Comment author: lukeprog 22 March 2011 03:19:21PM 4 points [-]

The inspiration from I.J. Good is there, but I'm not seeing much Yudkowsky. Still, very interesting quotes; thanks for sharing!

Comment author: steven0461 22 March 2011 06:44:03PM 4 points [-]

This at least is older than that.