Michaelos comments on What should a friendly AI do, in this situation? - Less Wrong

8 Post author: Douglas_Reay 08 August 2014 10:19AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (66)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 11 August 2014 12:54:08PM -1 points [-]

Hiding one channel bears no implication on the visibility of any generated channels.

I think this is a good key point.

If the programmers wish to have a hidden channel, and Albert's code independently suggests an identical channel that isn't hidden (Because Albert just came up with the idea.) then it is perfectly fine to just implement the open channel and to have Albert remember that fact. The entire reason to have the hidden channel is to prevent Albert from going below a certain level of transparent communication.

If Albert voluntarily communicates more, that's great, but you would still want to leave the hidden channel in as safety code.