Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

christopherj comments on Taboo Your Words - Less Wrong

72 Post author: Eliezer_Yudkowsky 15 February 2008 10:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (128)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: christopherj 03 December 2013 03:37:12PM -1 points [-]

"Obey me" is actually a sane approach to creating FAI. It's clear and simple. The obedient AI can then be used to create a FAI, assuming the author wishes to do so and is able to communicate the concept of friendliness (both prerequisites for creating a FAI on purpose). Since the FAI needs to obey a friendliness criteria, it needs to have an obey capability built in anyways. The author just needs to make sure not to say something stupid, which once again is a necessity anyways.

Comment author: TheOtherDave 03 December 2013 05:58:36PM 0 points [-]

You seem to be expecting an obedient AI to understand "obey me" to mean "do only what I say"... e.g., you expect the AI not to interpret hand gestures, for example.

Is that right?
If so, how confident are you of that expectation?

Comment author: christopherj 05 December 2013 08:03:13AM 0 points [-]

I'd expect the "obey me" aspect to be "read signed messages from this file or from your input and do what it says" then making sure that the AI can't get the signing key and cut out the middleman. Definitely not something as simple to overwrite or fake as microphone or keyboard inputs. Also that way I don't say things by accident, although any command could still have unintended consequences.

Comment author: TheOtherDave 05 December 2013 03:27:10PM 0 points [-]

OK, thanks for clarifying that.
Do you expect the signed messages to be expressed in a natural human language?

Comment author: christopherj 05 December 2013 06:32:09PM 0 points [-]

Unfortunately, that would be impossible, unless you can make an AI that can understand natural language before it is ever run. And that would require having a proper theory of mind right from the start.

Comment author: TheAncientGeek 05 December 2013 06:38:13PM -1 points [-]

Hello? Seed .AI?

Comment author: TheOtherDave 05 December 2013 07:12:19PM 0 points [-]

OK. Thanks for clarifying your expectations.