Vladimir_Nesov comments on Rolf Nelson: How to deter a rogue AI by using your first-mover advantage - Less Wrong

6 Post author: Kevin 17 November 2010 02:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 22 November 2010 02:26:20AM 0 points [-]

You are essentially arguing about moral value of consequences of actions in reality and simulations. The technique gets its strength through application of sufficient moral value of consequences in simulations, sufficient as an incentive for altering actions in reality. The extent to which control in reality is negotiated is given by the extent of the conditional moral value of simulations. Factoring in low probability of the threat, not much can be bought in reality, but some.