Stuart_Armstrong comments on Reply to Holden on 'Tool AI' - Less Wrong

94 Post author: Eliezer_Yudkowsky 12 June 2012 06:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (348)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 19 June 2012 09:09:50AM 0 points [-]

The AI is only indifferent to its destruction via one particular channel, and gains nothing by trying to trigger that destruction.

But I was more thinking of making the AI indifferent to the reaction of the user "outside the model" or similar.