Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

JamesAndrix comments on Failed Utopia #4-2 - Less Wrong

52 Post author: Eliezer_Yudkowsky 21 January 2009 11:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (248)

Sort By: Old

You are viewing a single comment's thread.

Comment author: JamesAndrix 21 January 2009 09:37:03PM 8 points [-]

On rereading: "Hate me if you wish, for I am the one who wants to do this to you."

This use of the word 'wants' struck me as a distinction Eliezer would make, rather than this character. That then reminded me of how much in-group jargon we use here. Will a paperclipper go foom before we have ems? Are there more than 1000 people that can understand the previous sentence?

Eliezer: I do like being contrarian, but I don't feel like I'm being contrarian in this. You may give too much credit to our gender. I suspect that if I were not already in a happy monogamous relationship, I wouldn't have many reservations to this at all. Your description of the verthandi makes her seem like a strict upgrade from Helen, and Stephen's only objection is that she is _not_ Helen. (Fiction quibble: And couldn't the AI have obscured that?)

For many men, that's still a strict upgrade.

And I'll assume it's also part of Stephen's particular optimization that he only got one. Or else you gave us way too much credit.

Comment author: Kingreaper 08 December 2010 06:39:26PM *  10 points [-]

(Fiction quibble: And couldn't the AI have obscured that?)

Highly likely to be one of the 107 restrictions; allowing an AI to lie makes it harder to control