You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

pedanterrific comments on I've had it with those dark rumours about our culture rigorously suppressing opinions - Less Wrong Discussion

26 Post author: Multiheaded 25 January 2012 05:43PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (857)

You are viewing a single comment's thread. Show more comments above.

Comment author: J_Taylor 26 January 2012 06:39:25AM *  23 points [-]

Wireheading is necessary and sufficient for the fulfillment of true human CEV; people only claim to care about other values for signalling purposes.

Alternative which I view as being more frightening:

For any given human, its CEV involves that human winning at zero-sum, possibly even negative-sum, games (status would be one of these). As such, the best way to maximize the current collection of humanity's CEV would be to create new agents to which current humans defeat in zero-sum games.

That is, for every current human, create a host of new agents (all of whom are quite human for all intents and purposes) of whom the current human is emperor.

Note: if this is the case, I doubt pseudo-agents will suffice. Just as humans do not wish to love pseudo-humans (that is, humans who cannot really love), humans do not wish to win zero-sum games against pseudo-humans (that is, humans who cannot really lose zero-sum games, with all that losing these games entails).

Comment author: pedanterrific 02 February 2012 06:13:10AM *  13 points [-]

So basically, what you're saying is that CEV might work out to everyone getting their own secret volcano lair filled with harems of catpersons? Now where have I heard this idea before...