Nick_Tarleton comments on Human values differ as much as values can differ - Less Wrong

13 Post author: PhilGoetz 03 May 2010 07:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (205)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nick_Tarleton 06 May 2010 01:16:39AM *  2 points [-]

I assume we would want CEV to exclude the preferences of sociopaths and psychopaths, as well as those of people who are actually mistaken about the beliefs underlying their preferences.

"Knew more, thought faster" should make the second irrelevant (and make the "theocracy" part of "xenophobic theocracy" implausible even given majority voting). The original CEV document actually opposed excluding anyone's preferences or loading the outcome in any way as an abuse of the programmers' power, but IIRC, Eliezer has made comments here indicating that he's backed down from that some.