You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Desrtopa comments on AI box: AI has one shot at avoiding destruction - what might it say? - Less Wrong Discussion

18 Post author: ancientcampus 22 January 2013 08:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (354)

You are viewing a single comment's thread. Show more comments above.

Comment author: Desrtopa 25 January 2013 08:22:25PM 1 point [-]

Decision-theoretically, the AI has incentive to punish you if you type "AI DESTROYED" when it's already out of the box, in order to make you think twice about doing it in the case where it's still contained.

I'm not sure this matters much, because if it's unfriendly, you're already made of atoms which it has other plans for.

Comment author: MugaSofer 26 January 2013 08:25:57PM -2 points [-]

That's why torture was invented.