Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

dgsinclair comments on Facing the Intelligence Explosion discussion page - Less Wrong

20 Post author: lukeprog 26 November 2011 08:05AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (133)

You are viewing a single comment's thread.

Comment author: dgsinclair 30 December 2011 11:35:54PM -2 points [-]

Luke, while I agree with the premise, I think that the bogie man of machines taking over may be either inevitable or impossible, depending on where you put your assumptions.

In many ways, machines have BEEN smarter and stronger than humans already. Machine AI may make individual or groups of machines formidable, but until they can reason, replicate, and trust or deceive, I'm not sure they have much of a chance.

Comment author: lessdazed 31 December 2011 03:01:32AM 4 points [-]

until they can...trust

Trust is one of the top four strengths they're missing?

Comment author: dbaupp 03 January 2012 12:19:17PM 1 point [-]

reason

What does "to reason" mean?

replicate

Getting there.

trust

Again, define "to trust".

deceive

Computers can deceive, they just need to programmed to (which is not hard). (I remember reading an article about computers strategically lying (or something similar) a while ago, but unfortunately I can't find it again)

(Although, it's very possible that a computer with sufficient reasoning power would just exhibit "trust" and "deception" (and self-replicate), because they enabled it to achieve its goals more efficiently.)