= 27d567bc2d48d9f40e9ccc20ea370b15)
cousin_it comments on The AI in a box boxes you - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (378)
This is a fun twist on Rolf Nelson's AI deterrence idea.
But I wonder if it's symmetrical. AI deterrence requires us to make statements now about a future FAI unconditionally simulating UFAIs, while this seems to be almost a self-fulfilling prophecy: the UFAI can't escape from the box and make good on its threat unless the threatened person gives in, and it wouldn't need to simulate then.
How sure are you someone else won't walk by whose mind it can hack?
Yes - the threat is only credible in proportion to the AI's chance of escaping and taking over the world without my help.
If I have reason to believe that probability is high then negotiating with the AI could make sense.