Stuart_Armstrong comments on AI risk, executive summary - LessWrong

10 Post author: Stuart_Armstrong 07 April 2014 10:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (51)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 08 April 2014 05:52:28PM *  0 points [-]

What if I interweaved more nasty people in the list? The difference between morality and competence is something that I'd like to imply (and there is little room to state it explicitly).

Comment author: [deleted] 08 April 2014 08:40:51PM *  1 point [-]

I dunno. Goebbels is evil. I don't think you are trying to say (correct me if I'm wrong here) that the problem with haphazard AI is evil. The problem is that it won't be a moral being at all. All the people on that list are morally complicated individuals. My first reaction to the idea that they would be networked together is that they would probably get into some heated arguments. I really just don't see Einstein and Goebbels getting along on any kind of project, and if I'm not imagining them with their moral qualities attached, then what's the point of naming them in particular?

Maybe this is a workable alternative:

The AI could also make use of its unique, non-human architecture. If it existed as pure software, it could copy itself many times, training each copy at accelerated computer speed, and networking those copies together. Imagine a body of researchers many times bigger than the world's entire scientific community, working without rest, communicating perfectly and instantaneously, and without regard for tenure. It could continue copying itself without limit, creating millions or billions of copies, if it needed large numbers of minds to brute-force a solution to any particular problem.

In any case, I wouldn't put too much emphasis on the orthogonality thesis in this document. That's sort of a fancy argument, and not one that's likely to come up talking to the public. Movies kind of took care of that for you.

Comment author: Stuart_Armstrong 17 April 2014 11:12:36AM 0 points [-]

Thanks! will think about that...