= 27d567bc2d48d9f40e9ccc20ea370b15)
Kevin comments on Open Thread: May 2010 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (543)
I agree that AI deterrence will necessarily fail if:
All AI's modify themselves to ignore threats from all agents (including ones it considers irrational), and
any deterrence simulation counts as a threat.
Why do you believe that both or either of these statements are true? Do you have some concrete definition of 'threat' in mind?
I don't believe statement 1 and don't see why it's required. After all, we are quite rational, and so is our future FAI.