You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

ShardPhoenix comments on Open Thread, May 12 - 18, 2014 - Less Wrong Discussion

5 Post author: eggman 12 May 2014 08:16AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (201)

You are viewing a single comment's thread. Show more comments above.

Comment author: ShardPhoenix 13 May 2014 11:13:08AM *  1 point [-]

You could possibly say "I wish for you to tell me you would wish for if you had your current intelligence and knowledge, but the same values and desires as me." That would still require just the right combination of intelligence, omniscience, and literal truthfulness on the genie's part though.

Comment author: RichardKennaway 13 May 2014 11:38:40AM *  7 points [-]

The genie replies, "What I would wish for in those circumstances would only be of value to an entity of my own intelligence and knowledge. You couldn't possibly use it. And beside, I'm sorry, but there's no such thing as 'your values and desires'. You're barely capable of carrying out a decision made yesterday to go to the gym today. You might as well ask me to make colourless green ideas sleep furiously. On a more constructive note, I suggest you start small, and wish for fortunate chances of a scale that could actually happen without me, that will take you a little in whatever direction you want to go. I'll count something that size as a milli-wish. Then tomorrow you can make another, and so on. I have to warn you, though, that still ends badly for some people. Giving you this advice counts as your first milli-wish. See you tomorrow."

Comment author: [deleted] 13 May 2014 05:33:17PM 0 points [-]

I'm nowhere near that confident in my values and desires.

Comment author: Strilanc 13 May 2014 01:31:36PM *  0 points [-]

I wish for you to tell me [what] you would wish for [in my place] if you had your current intelligence and knowledge, but the same values and desires as me.

  • "You should wish for me to tell you what you would wish for in your place if I had your current intelligence and knowledge, but the same values and desires as you."

  • "I have replaced your values and desires with my own. You should wish to become a genie."

  • "Here is your list of all possible wishes."

  • "You should wish that genies never existed."