Incorrect comments on I attempted the AI Box Experiment (and lost) - Less Wrong

47 Post author: Tuxedage 21 January 2013 02:59AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (244)

You are viewing a single comment's thread.

Comment author: Incorrect 21 January 2013 01:58:35PM 2 points [-]

Oh god, remind me to never play the part of the gatekeeper… This is terrifying.

Comment author: wedrifid 22 January 2013 01:59:48AM 0 points [-]

Oh god, remind me to never play the part of the gatekeeper… This is terrifying.

Why is it that the role of gatekeeper terrifies you? I'm curious. The role of the AI sounds mildly abhorrent to me but being the gatekeeper seems relaxing. It isn't that hard to say "No, and after talking to you for the allotted time is up I'm going to raze your entire building with thermite."

(Mind you, the prospect of playing gatekeeper against an actual AI and for some reason not being able to destroy it instantly does sound terrifying! But humans are different.)

Comment author: drethelin 22 January 2013 05:13:49AM *  5 points [-]

You're consenting to have your mind attacked with all the mental weapons at someone's disposal. This is a lot scarier because you're willingly giving up some measure of control over your state to the other person, however difficult it may be for them. You're also being attacked as yourself. The AI player is playing a role, and attacking within that role. Their own mental wellbeing is a lot less at risk, unless they think they've got horrible depths they never want to sink to.

to make a shitty analogy: It's like being at the top of a tower while someone tries to knock it down with their bare hands. Even if they have very little chance and have to expend a lot more effort than you, you're the one who's risking the greatest pain

Comment author: Error 23 January 2013 11:26:47PM 1 point [-]

Their own mental wellbeing is a lot less at risk, unless they think they've got horrible depths they never want to sink to.

If I remember right, that was at least part of why Eliezer stopped playing in the first place. Manifesting as a sociopath is non-trivial and invites some fairly heavy cognitive dissonance.