Soki comments on Suggestions for a presentation on FAI? - Less Wrong

2 Post author: ShardPhoenix 11 February 2011 06:09AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (9)

You are viewing a single comment's thread.

Comment author: Soki 11 February 2011 09:09:25PM *  1 point [-]

Despite the fact that your audience is familiar with the singularity, I would still insist on the potential power of an AGI.
You could say something about the AI spreading on the Internet (from a 1000 to 1,000,000 time increase in processing power), bootstrapping nanotech and rewriting its source code, and that all of this could happen very quickly.

Ask them what they think such an AI would do, and if they show signs of anthropomorphism explain them that they are biased (mind projection fallacy for example).
You can also ask them what goal they would give to such an AI and show what kind of disaster may follow.
That can lead you to the complexity of wishes (a computer does not have common sens) and the complexity of human values.

I would also choose a nice set of links to lesswrong.org and singinst.com that they could read after the presentation.

It would be great if you could give us some feedback after your presentation : What worked, what did they find odd, what was their reaction, what questions did they ask.

Comment author: ShardPhoenix 23 February 2011 12:17:40PM 1 point [-]

I did the presentation a week ago. It went over quite well - several people told me they enjoyed it. In general, people asked pretty sensible questions (eg, about IA vs. AI) that helped generate some good discussion.

Here are the slides (pretty brief - I didn't want to include too much text): http://www.megaupload.com/?d=6YTPVVFX