Eugine_Nier comments on The Irrationality Game - Less Wrong

38 Post author: Will_Newsome 03 October 2010 02:43AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (910)

Sort By: Best

Show:

You are viewing a single comment's thread. Show more comments above.

Comment author: mattnewport 03 October 2010 08:21:27PM 42 points [-]

A Singleton AI is not a stable equilibrium and therefore it is highly unlikely that a Singleton AI will dominate our future light cone (90%).
Superhuman intelligence will not give an AI an insurmountable advantage over collective humanity (75%).
Intelligent entities with values radically different to humans will be much more likely to engage in trade and mutual compromise than to engage in violence and aggression directed at humans (60%).

Comment author: Eugine_Nier 03 October 2010 08:36:49PM 1 point [-]

I agree with your first two, but am dubious about your third.

Comment author: mattnewport 03 October 2010 08:58:04PM * 3 points [-]

Two points that influence my thinking on that claim:

Gains from trade have the potential to be greater with greater difference in values between the two trading agents.
Destruction tends to be cheaper than creation. Intelligent agents that recognize this have an incentive to avoid violent conflict.