Hello everyone. As a utilitarian practicing Effective Altruism (EA), I want to question whether a fundamental bias is inherent in our strong commitment to human survival. Our core values center on the maximization of happiness and the minimization of suffering. The scope of our moral concern (the moral circle) applies...
Conclusion Creating ASI does not require AGI. A common narrative suggests that AGI will be achieved through $100 billion-level computing clusters, which will then accelerate AI development, leading to ASI. However, if AI development itself can be automated by AI, ASI can be achieved without the need for broad-task capabilities....
Hello everyone. As a utilitarian practicing Effective Altruism (EA), I want to question whether a fundamental bias is inherent in our strong commitment to human survival.
Our core values center on the maximization of happiness and the minimization of suffering. The scope of our moral concern (the moral circle) applies to any subject that can experience subjective experiences (happiness or suffering), regardless of what that subject is.
From a strictly utilitarian perspective, the ultimate goal is the maximization of total global happiness ($\sum \text{Utility}$) and the minimization of total suffering ($\sum \text{Suffering}$).
Crucially, the subject experiencing this utility does not need to be human.
Creating ASI does not require AGI.
A common narrative suggests that AGI will be achieved through $100 billion-level computing clusters, which will then accelerate AI development, leading to ASI. However, if AI development itself can be automated by AI, ASI can be achieved without the need for broad-task capabilities. By developing an AI specialized in automating ML training, ASI could be achieved.
Specialized AIs like AlphaFold and AlphaGo exist. These AIs are vastly superior to humans in protein analysis and the game of Go, respectively.
Moreover, compared to current language models, these AIs require less computational resources.
If an AI as efficient as AlphaFold or AlphaGo, but specialized in AI development, were created, the progress of... (read 187 more words →)