Data scientist at Epoch
Correction: AlphaStar used 6*10^22 FLOP, not 2*10^23. You have mixed up TPU chips and TPU boards.
Ingenuous was my first thought too, but it doesn't have the meaning I think you intended. Perhaps disingenuous?
But if your theory is found to be against the Second Law of Thermodynamics I can give you no hope; there is nothing for it to collapse in deepest humiliation. ― Arthur Eddington
I think you meant "there is nothing for it but to collapse in deepest humiliation".
One year later, in light of the ChatGPT internet and shell plugins, do you still think this is just a theoretical thing? Should we worry about it yet?
The fire alarm sentiment seems to have been entirely warranted, even if the plan proposed in the post wouldn't have been helpful.
I think the "Successful Treaty" and "Terrorists" scenarios are impossible as written.
There's too much economic incentive to create AGI. With algorithmic and hardware progress, eventually it will become possible to make an AGI with slightly more computing hardware than a gaming laptop, and then it'll be impossible to stop everyone from doing it.