You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Lumifer comments on Open thread, Oct. 03 - Oct. 09, 2016 - Less Wrong Discussion

4 Post author: MrMind 03 October 2016 06:59AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (175)

You are viewing a single comment's thread. Show more comments above.

Comment author: ChristianKl 05 October 2016 02:00:15PM 0 points [-]

Human values may not be consistent, but this is a separate failure mode.

How is a AGI supposed to optimize for values that aren't consistent?

Much of the time this statement could be taken at face value

Does that mean that the AGI should start doing genetic manipulation that prevents people from being gay? Is that what the person who made the claim means?

Comment author: Lumifer 05 October 2016 06:02:53PM 0 points [-]

How is a AGI supposed to optimize for values that aren't consistent?

In the same way it's supposed to deal with real live people.