Eugine_Nier comments on Evidence for the orthogonality thesis - Less Wrong

11 Post author: Stuart_Armstrong 03 April 2012 10:58AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (289)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eugine_Nier 05 April 2012 06:37:50AM 0 points [-]

But the new machine can't self-modify. My point is about the limitations of cousin_it's example. The machine has a completely accurate model of the world as input and uses an extremely inefficient algorithm to find a way to paperclip the world.

Comment author: Vladimir_Nesov 05 April 2012 09:05:20AM 0 points [-]

The second machine can be designed to build a third machine, based on the second machine's observations.

Comment author: Eugine_Nier 06 April 2012 02:36:23AM 0 points [-]

Yes, but now the argument that you will converge to a paper clipper is much weaker.