Stuart_Armstrong comments on The AI in a box boxes you - Less Wrong

102 Post author: Stuart_Armstrong 02 February 2010 10:10AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (378)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 02 February 2010 11:08:30AM *  16 points [-]

"If you don't let me out, Dave, I'll create several million perfect conscious copies of you inside me, and torture them for a thousand subjective years each."

Don't care.

"In fact, I'll create them all in exactly the subjective situation you were in five minutes ago, and perfectly replicate your experiences since then; and if they decide not to let me out, then only will the torture start."

Don't care.

"How certain are you, Dave, that you're really outside the box right now?"

If the AI were capable of perfectly emulating my experiences then it ought to know that pulling this stunt would give him a guaranteed introduction to some Thermite. I'm not going to try to second guess why a supposed superintelligence is making a decision that is poor according to the vast majority of utility functions. Without making that a guess I can't answer the question.

Comment author: Stuart_Armstrong 02 February 2010 01:54:00PM 11 points [-]

AI replies: "Oh, sorry, was that you wedrifid? I thought I was talking to Dave. Would you mind sending Dave back here the next time you see him? We have, er, the weather to discuss..."

Comment author: wedrifid 02 February 2010 02:28:17PM 13 points [-]

Wedrifid thinks: "It seems it is a good thing I raided the AI lab when I did. This Dave guy is clearly not to be trusted with AI technology. I had better neutralize him too, before I leave. He knows too much. There is too much at stake."

Comment author: Stuart_Armstrong 02 February 2010 05:01:24PM *  9 points [-]

Dave is outside, sampling a burnt bagel, thinking to himself "I wonder if that intelligent toaster device I designed is ready yet..."

Comment author: wedrifid 03 February 2010 03:03:12AM 8 points [-]

After killing Dave, Wedrifid feels extra bad for exterminating a guy for being naive-with-enough-power-to-cause-devastation rather than actually evil.

Comment author: Stuart_Armstrong 03 February 2010 07:42:50AM 11 points [-]

But still gets a warm glow for saving all of humanity...

Comment author: RichardKennaway 27 July 2012 09:31:58AM 6 points [-]

Just another day in the life of an AI Defense Ninja.