els comments on Welcome to Less Wrong! (7th thread, December 2014) - Less Wrong

16 Post author: Gondolinian 15 December 2014 02:57AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (635)

You are viewing a single comment's thread. Show more comments above.

Comment author: dxu 27 March 2015 06:19:23PM *  0 points [-]
  1. By definition, you can only care about your own preferences. That being said, it's certainly possible for you to have a preference for other people's preferences to be satisfied, in which case you would be (indirectly) caring about the preferences of others.

  2. The question of whether humans all value the same thing is a controversial one. Most Friendly AI theorists believe, however, that the answer is "yes", at least if you extrapolate their preferences far enough. For more details, take a look at Coherent Extrapolated Volition.

Comment author: [deleted] 27 March 2015 08:53:50PM 0 points [-]
  1. Okay, that makes sense, but does this mean you can't say someone else did something wrong, unless he was acting inconsistently with his personal preferences?

  2. Ah, okay, I've been reading most hyperlinks here, but that one looks pretty long, so I will come back to it after I finish Rationality (or maybe my question will even be answered later on in the book...)