timtyler comments on Cryptographic Boxes for Unfriendly AI - Less Wrong

24 Post author: paulfchristiano 18 December 2010 08:28AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (155)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 18 December 2010 03:25:06PM *  4 points [-]

Moral value can manipulate your concerns, even as you prevent causal influence. Maybe the AI will create extraordinary people in its mind, and use that as leverage to work on weak points of your defense. It's just too difficult, you are bound to miss something. The winning move is not to play.

Comment author: timtyler 19 December 2010 07:29:30PM 0 points [-]

The winning move is not to play.

Very rarely is the winning move not to play.

It seems especially unlikely to be the case if you are trying to build a prison.