I agree with almost all of this analysis, but I’m surprised at any suggestion that government shouldn’t be encouraged to pay more attention to AI.
The common tendency in the tech sphere to downplay government involvement seems maladaptive when applied to AGI. It was a useful instinct when resisting regulation that could stifle harmless innovation; it is an unhelpful one when applied to the dangerous development now taking place.
AGI seems like a scenario that governmental bodies are better calibrated towards handling than corporate ones, as governments are at least partially incentivised to account for the public good. Meanwhile, the entire history of the corporation is one of disregard for negative externalities. From the... (read more)
I agree with almost all of this analysis, but I’m surprised at any suggestion that government shouldn’t be encouraged to pay more attention to AI.
The common tendency in the tech sphere to downplay government involvement seems maladaptive when applied to AGI. It was a useful instinct when resisting regulation that could stifle harmless innovation; it is an unhelpful one when applied to the dangerous development now taking place.
AGI seems like a scenario that governmental bodies are better calibrated towards handling than corporate ones, as governments are at least partially incentivised to account for the public good. Meanwhile, the entire history of the corporation is one of disregard for negative externalities. From the... (read more)