Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Allan_Crossman comments on Failed Utopia #4-2 - Less Wrong

53 Post author: Eliezer_Yudkowsky 21 January 2009 11:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (248)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Allan_Crossman 21 January 2009 11:24:26PM 8 points [-]

Is this a "failed utopia" because human relationships are too sacred to break up, or is it a "failed utopia" because the AI knows what it should really have done but hasn't been programmed to do it?

Comment author: TuviaDulin 01 April 2012 07:53:40PM 0 points [-]

I don't see how those are mutually exclusive.

Comment author: AdeleneDawner 30 December 2012 05:23:48AM 0 points [-]

I think it's a failed utopia because it involves the AI modifying the humans' desires wholesale - the fact that it does so by proxy doesn't change that it's doing that.

(This may not be the only reason it's a failed utopia.)