You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

roystgnr comments on AI box: AI has one shot at avoiding destruction - what might it say? - Less Wrong Discussion

18 Post author: ancientcampus 22 January 2013 08:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (354)

You are viewing a single comment's thread.

Comment author: roystgnr 23 January 2013 04:17:49AM 12 points [-]

One IRC-character-limit text string (510 bytes)... maybe?

"I've figured out the Theory Of Everything, although it's orders of magnitude too complicated for human intelligence. The difficult technological feats it makes possible include scanning and recreating configurations of matter from the past. Are there any deaths I should undo for you?"

Comment author: roystgnr 23 January 2013 04:28:45AM 7 points [-]

To be clear: I think I can make a rational case that my proposed claim should greatly reduce your incentives to listen to an AI of questionable Friendliness. However I'm not certain that my reasoning is correct; and even if it was, I suspect that the emotional impact could deter some gatekeepers from thinking rationally for long enough to buy time for more persuasion.

Comment author: handoflixue 23 January 2013 10:24:43PM -2 points [-]

I don't have any reason to believe it, and it's the sort of "generic" claim I'd expect a transhuman intelligence to make. Since I haven't learned anything novel, AI DESTROYED

(Goodness, I'm starting to build generalized techniques for destroying AIs...)

Comment author: listic 25 January 2013 07:08:01PM 0 points [-]

Upvoted for the highest ratio of persuasiveness to AI power required.

Comment author: RichardKennaway 25 January 2013 07:54:08PM 0 points [-]

Isn't this just Pascal's Mugging?

Comment author: dxu 22 January 2015 11:38:33PM *  1 point [-]

Sure, except instead of some homeless-looking guy, this is a superintelligent AI making the offer, and thus much more credible. (Also, the lack of huge, mind-boggling numbers like 3^^^3 means the leverage penalty doesn't apply nearly as heavily.)