You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Eugine_Nier comments on Non-orthogonality implies uncontrollable superintelligence - Less Wrong Discussion

14 Post author: Stuart_Armstrong 30 April 2012 01:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (45)

You are viewing a single comment's thread.

Comment author: Eugine_Nier 01 May 2012 02:24:46AM 0 points [-]

There are still reasons to control it, e.g., making sure it doesn't destroy the earth before converging on the true morality.

These are also theories that the true morality comes from the interaction of multiple agents and that therefore a single super-powerful agent won't necessarily converge on it.