I'm wondering what people would think about adopting the term Future Super Intelligences or FSI, rather than AGI or SAGI.
This would cover more scenarios (e.g. uploads/radical augments) where the motivational systems of super powerful actors may not be what we are used to. It would also show that we are less worried about current tech than talking about AIs does, there is that moment when you have to explain you are not worried about backprop.
I never really thought that AGI implied any specific technology; certainly the "G" in AGI rules out the likelihood of AGI referring to current technology since current technology is not generally intelligent. AGI seems to capture what it is we are talking about quite well, IMO - Artificial (i.e. man-made) General Intelligence.
Do you really find yourself explaining that AGI is not the same as backpropagation very often?
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should start on Monday, and end on Sunday.
4. Unflag the two options "Notify me of new top level comments on this article" and "