You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Mac comments on [link] Thoughts on defining human preferences - Less Wrong Discussion

6 Post author: Kaj_Sotala 31 March 2015 10:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (5)

You are viewing a single comment's thread.

Comment author: Mac 31 March 2015 09:45:56PM *  0 points [-]

Not sure I completely understand, but is this a possibility under your proposal?

AI: “Voila!”

Humans: “Uh, that’s not what we want.”

AI: “No, but it’s what you want to want.”

Hopefully the AI makes us want what we want to want. Then we’d say…

Humans: “Yay! Broccoli for dinner again!”

Comment author: RomeoStevens 01 April 2015 11:00:34PM 0 points [-]

In the present world we are forced, due to resource constraints, between virtuous values and hedonistic values. It isn't that we want to force ourselves to choose the virtuous, we want to dissolve the need to choose between them so we can satisfy both.