ciphergoth comments on Failed Utopia #4-2 - Less Wrong

52 Post author: Eliezer_Yudkowsky 21 January 2009 11:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (247)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: Will_Newsome 30 May 2013 06:09:17AM *  6 points [-]

If a genie cares enough about your request to interpret and respond to its naive denotation, it also cares enough to interpret your request's obvious connotations. The apparently fine line between them is a human construction. Your proposed interpretation only makes sense if the genie is a rules-lawyer with at-least-instrumentally-oppositional interests/incentives, in which case one wonders where those oppositional interests/incentives came from. (Which is where we're supposed to bring in Omohundro et cetera but meh.)

Comment author: ciphergoth 30 May 2013 06:28:12AM 16 points [-]

Right, if you want a world that's all naive denotation, zero obvious connotation, that's computer programming!