John_Maxwell_IV comments on I attempted the AI Box Experiment (and lost) - Less Wrong

47 Post author: Tuxedage 21 January 2013 02:59AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (244)

You are viewing a single comment's thread.

Comment author: John_Maxwell_IV 21 January 2013 10:52:33AM *  11 points [-]

The AI box experiment is a bit of strawman for the idea of AI boxing in general. If you were actually boxing an AI, giving it unencumbered communication with humans would be an obvious weak link.

Comment author: Eliezer_Yudkowsky 21 January 2013 08:00:35PM 18 points [-]

Not obvious. Lots of people who propose AI-boxing propose that or even weaker conditions.

Comment author: Qiaochu_Yuan 22 January 2013 10:38:16AM *  9 points [-]

Fictional evidence that this isn't obvious: in Blindsight, which I otherwise thought was a reasonably smart book (for example, it goes out of its way to make its aliens genuinely alien), the protagonists allow an unknown alien intelligence to communicate with them using a human voice. Armed with the idea of AI-boxing, this seemed so stupid to me that it actually broke my suspension of disbelief, but this isn't an obvious thought to have.

Comment author: JoachimSchipper 23 January 2013 08:06:20AM 1 point [-]

Spoiler: Gura ntnva, gur nyvra qbrf nccneragyl znantr gb chg n onpxqbbe va bar bs gur uhzna'f oenvaf.