Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Lightwave2 comments on Qualitative Strategies of Friendliness - Less Wrong

10 Post author: Eliezer_Yudkowsky 30 August 2008 02:12AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (56)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Lightwave2 30 August 2008 11:24:56AM 0 points [-]

Just like you wouldn't want an AI to optimize for only some of the humans, you wouldn't want an AI to optimize for only some of the values. And, as I keep emphasizing for exactly this reason, we've got a lot of values.

What if the AI emulates some/many/all human brains in order to get a complete list of our values? It could design its own value system better than any human.

Comment author: DragonGod 08 November 2017 04:23:46PM 0 points [-]

There is no machine in the ghost.