= 27d567bc2d48d9f40e9ccc20ea370b15)
shminux comments on Breakdown of existential risks - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (21)
Why does superintelligence require global coordination? Apparently all one needs to do is to develop an FAI, and the rest will take care of itself.
E.g. AI regulation (like most technology regulation) is only effective if you get the whole world on board, and without global coordination there's the potential for arms races.
"Only develop an FAI" also presumes a hard takeoff, and it's not exactly established beyond all doubt that we'll have one.
Preventing UFAI or dealing safely with Oracles or using reduced impact AIs requires global coordination. Only the "FAI in a basement" approach doesn't.
Because FAI is a hard problem. If it were easy then we would not still be paying people $70 trillion per year worldwide to do work that machines aren't smart enough to do yet.
Almost all of these are hard problems. That seems insufficient.