= 27d567bc2d48d9f40e9ccc20ea370b15)
Squark comments on Will AGI surprise the world? - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (129)
I don't understand what point you're trying to make. My point was that cooperative game theory doesn't magically guarantee a UFAI will treat us nicely. It might work but only if there is a sufficiently substantial Everett branch with a FAI. The probability of that branch probably strongly depends on effort invested into FAI research.
If the probability of FAI (and friendly uploads etc) is near zero, then we're doomed either way. But even though I believe the probability of provably friendly AI coming first is <50% , its definitely not 10^-11!
Fair enough, but there's still an enormous incentive to work on FAI.
Of course, I was not trying to suggest otherwise.