You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

VAuroch comments on Some alternatives to “Friendly AI” - Less Wrong Discussion

19 Post author: lukeprog 15 June 2014 07:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (44)

You are viewing a single comment's thread.

Comment author: VAuroch 16 June 2014 11:39:59PM -1 points [-]

Computer security might be a good metaphor, at least in some contexts (particularly institutional contexts). Secure AI or Human-Secure AI gets across the general quality of high stakes with more appropriate connotations than High-Assurance and less impossible.

It also has the bonus that it draws an implicit connection to mathematical security, since insofar as we can say anything about eventual implementation of a Friendly/Safe/Secure AGI, it's fair to say that it's extremely likely to rely on advances descending from current techniques in provably-secure computing. Also the bonus that talking up security is frequently a good way to get Organizations With Money to start reaching for their wallets.

Comment author: Lumifer 17 June 2014 12:40:36AM 1 point [-]

Computer security might be a good metaphor, at least in some contexts (particularly institutional contexts). Secure AI or Human-Secure AI gets across the general quality of high stakes with more appropriate connotations than High-Assurance and less impossible.

In this context "secure AI" has the connotations of being well-protected against hackers.

Comment author: VAuroch 17 June 2014 03:16:57AM -1 points [-]

Well, that should be a necessary if not sufficient condition. Do you think it would dominate other interpretations to laymen/nonexperts?

Comment author: Lumifer 17 June 2014 04:11:49PM 2 points [-]

I think that "secure" generally has the connotations of being secure against external threats. A "secure facility" is one into which outsiders cannot get into, but it may well contain nuclear bombs.