You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Lumifer comments on Crazy Ideas Thread - Less Wrong Discussion

22 Post author: Gunnar_Zarncke 07 July 2015 09:40PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (344)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 08 July 2015 05:37:42PM 4 points [-]

What, no conditionality there? I guess all EY's scary stories about not-quite-benevolent genies were a waste, after all... X-)

Comment author: James_Miller 08 July 2015 05:47:58PM 2 points [-]

I trust it to understand my intent based on everything else it can learn about me. Plus, there is probably nothing I could write that would protect me against a not-quite-benevolent genie who wanted to harm me but was constrained by the literal meaning of what I wrote.

Comment author: Lumifer 08 July 2015 05:52:02PM *  0 points [-]

there is probably nothing I could write that would protect me against a not-quite-benevolent genie

True, but the interesting question is whether you want to summon a genie of uncertain benevolence.

Comment author: James_Miller 08 July 2015 06:21:37PM 0 points [-]

I wouldn't summon a genie of uncertain benevolence. But if one already exists it might be worth asking it for a favor. Most unfriendly genies would ignore my wishes. The question is, do you want to draw the attention of a genie of uncertain benevolence that is influenced by your explicit requests to it?

Comment author: fubarobfusco 09 July 2015 04:00:40AM 2 points [-]

You have heard it said, "Do not call up that which you cannot put down."

But I tell you, "That's how we got here."