Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

NancyLebovitz comments on Failed Utopia #4-2 - Less Wrong

53 Post author: Eliezer_Yudkowsky 21 January 2009 11:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (248)

Sort By: Old

You are viewing a single comment's thread.

Comment author: NancyLebovitz 22 January 2009 05:07:00PM 2 points [-]

Science fiction fandom makes me happy. Tear it into two separate pieces, and the social network is seriously damaged.

Without going into details, I have some issues about romantic relationships-- it's conceivable that a boreana could make me happy (and I'm curious about what you imagine a boreana to be like), but I would consider that to be direct adjustment of my mind, or as nearly so as to not be different.

More generally, people tend to have friends and family members of the other sex. A twenty-year minimum separation is going to be rough, even if you've got "perfect" romantic partners.

If I were in charge of shaping utopia, I'd start with a gigantic survey of what people want, and then see how much of it can be harmonized. That would at least be a problem hard enough to be interesting for an AI.

If that's not feasible, I agree that some incremental approach is needed.

Alternatively, how about a mildly friendly AI that just protects us from hostile AIs and major threats to the existence of human race? I realize that the human race will be somewhat hard to define, but that's just as much of a problem for the "I just want to make you happy" AI.