Eugine_Nier comments on Rationality Quotes August 2012 - Less Wrong

6 Post author: Alejandro1 03 August 2012 03:33PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (426)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eugine_Nier 26 August 2012 09:00:26PM 1 point [-]

I'm proposing a system where the AI is only ever willing to use a few appendages to effect the outside world, as opposed to potentially dozens.

The problem is that the AI could use its appendages to create and use tools that are more powerful than the appendages themselves.

Comment author: chaosmosis 27 August 2012 05:53:28PM 0 points [-]

I've already addressed this, the AI would still be entirely dependent on its appendages and that's a major advantage. So long as we watch the appendages and act to check any actions by them that seem suspicious then the AI would remain weak. The AI isn't magic, and it's not even beyond the scope of human cunning if we limit its input data. Again, also keep in mind also that we'd watch the communications between the appendages and the AI as well, so we'd know immediately if it was trying to get them to make it any tools. The Gatekeepers wouldn't exist in a vacuum, they would be watched over and countered by us.