paulfchristiano comments on SRG 4: Biological Cognition, BCIs, Organizations - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (139)
It seems like the characterization of outcomes into distinct "routes" is likely to be fraught; even if such a breakdown was in some sense exhaustive I would not be surprised if actual developments didn't really fit into the proposed framework. For example, there is a complicated and hard to divide space between AI, improved tools, brain-computer interfaces, better institutions, and better training. I expect that ex post the whole thing will look like a bit of a mess.
One practical result is that even if there is a strong deductive argument for X given "We achieve superintelligence along route Y" for every particular Y in Bostrom's list, I would not take this as particularly strong evidence for X. I would instead view it as having considered a few random scenarios where X is true, and weighing this up alongside other kinds of evidence.