NancyLebovitz comments on Hedging our Bets: The Case for Pursuing Whole Brain Emulation to Safeguard Humanity's Future - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (244)
Why should an uploaded superintelligence based on a human copy be any innately safer than an artificial superintelligence? Just because humans are usually friendly doesn't mean a human AI would have to be friendly. This is especially true for a superintelligent human AI, which may not even be comparable to its original human template. Even the friendliest human might be angry and abusive when they're having a bad day.
Your idea that a WBE copy would be easier to undergo a relatively more enhanced supervised, safe growth, is basically an assumption. You would need to argue this in much more detail for it to merit deeper consideration.
Also, you cannot assume that an uploaded human superintelligence would be more constrained, as in "...after a best-effort psychiatric evaluation (for whatever good that might do) gives it Internet access". This is related to the the AI-box problem, where it is contended that a superintelligence could not be contained, no matter what. Personally I dispute this, but at least it's not something to be taken for granted.
At least we know what a friendly human being looks like.
And I wouldn't stop at a psychiatric evaluation of the person to be uploaded. I'd work on evaluating whether the potential uploadee was good for the people they associate with.