Comment on Cryptographic Boxes for Unfriendly AI

Sat, 18 Dec 2010 15:16:38 GMT

The probability I assign to achieving a capability state where it is (1) possible to prove a mind Friendly even if it has been constructed by a hostile superintelligence, (2) possible to build a hostile superintelligence, and (3) not possible to build a Friendly AI directly, is very low.

A general theory of quarantines would nevertheless be useful.

Discuss