JoshuaZ comments on Rolf Nelson: How to deter a rogue AI by using your first-mover advantage - Less Wrong

6 Post author: Kevin 17 November 2010 02:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread. Show more comments above.

Comment author: JoshuaZ 17 November 2010 07:51:24PM 0 points [-]

That requires very detailed rules about manipulating agents within the system rather than doing a straight physics simulation (otherwise what do you do when it modifies its memory system). I'm not arguing that it isn't possibly doable, just that it doesn't seem necessarily to be likely.