JamesAndrix comments on Cryptographic Boxes for Unfriendly AI - Less Wrong

24 Post author: paulfchristiano 18 December 2010 08:28AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (155)

You are viewing a single comment's thread. Show more comments above.

Comment author: JamesAndrix 19 December 2010 05:40:58PM 3 points [-]

For all they know, the uFAI is just sitting in the corner and sulking.

This quite possibly the optimal response. If we don't get FAI out of the first attempt, we might try again with another similar design, possibly giving the uFAI more resources. This twin uFAI is much more likely to implement the uFAI's goals than any FAI it might create.

Even a single bit is too much control if we need the bit to be set to 1.