JoshuaZ comments on AI Risk and Opportunity: A Strategic Analysis - Less Wrong

8 Post author: lukeprog 04 March 2012 06:06AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (161)
Tags: singularity ai

Comments (161)

You are viewing a single comment's thread. Show more comments above.

Comment author: JoshuaZ 10 March 2012 04:40:23PM *  0 points [-]

Extremely hard, more powerful than you can possibly imagine, but people will be free to opt out if they desire.

Consider the uploaded individual that decides to turn the entire planet into computronium or worse, turn the solar system into a Matrioshka brain. People opt out of that how?

Promote the idea of Post-Scarcity thus people in power will realise all wars are needless because all wars stem from resource scarcity

It isn't obvious to me that all wars stem from resource scarcity. Wars occur for a variety of reasons, of which resource scarcity is only one. Often wars have multiple underlying causes. Some wars apparently stem from ideological or theological conflicts (Vietnam, Korea, the Crusades) or from perceived need to deal with external threats before them become too severe (again the Crusades, but also the recent Iraq war (which yes, did have a resource aspect)). These are only some of the more prominent examples of what can cause war.

Comment author: SingularityUtopia 10 March 2012 07:23:04PM *  -2 points [-]

Dear JoshuaZ, regarding this:

"Consider the uploaded individual that decides to turn the entire planet into computronium or worse, turn the solar system into a Matrioshka brain. People opt out of that how?"

I consider such a premise to be so unlikely it is impossible. It is a very silly premise for three reasons.

  1. Destroying the entire planet when there is a whole universe full of matter is insane. If insane people exist in the future post-intelligence-explosion upload-world then insane people will be dealt with thus no danger but insanity post-intelligence-explosion will be impossible, insanity is a consequence of stupidity, insanity will be extinct in the future.

  2. Earth destructive actions are stupid: see above explanation regarding insanity: it also explains how stupidity will be obsolete.

  3. People opt out by stating they want to opt out. I'm sure an email will suffice.

It isn't obvious to me that all wars stem from resource scarcity.

Sorry that it isn't obvious how scarcity causes war. I don't have time to explain so I will leave you with some consensual validation regarding Ray Kurzweil who seems to think the war-scarcity interrelationship is obvious:

"I've actually grown up with a history of scarcity — and wars and conflict come from scarcity — but information is quite the opposite of that." ~ Ray Kurzweil http://www.hollywoodreporter.com/risky-business/sxsw-2012-damon-lindelof-ray-kurzweil-297218

Powered by Reddit Powered by Reddit