JamesAndrix comments on Hedging our Bets: The Case for Pursuing Whole Brain Emulation to Safeguard Humanity's Future - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (244)
So, in this scenario we have obtained a big neural network that imprints on a master and can learn complex physical tasks... and we're just going to ignore the implications of that while we concentrate on trying to duplicate ourselves?
What's going to stop me from duplicating just the canine prefrontal cortex and experimenting with it? It's a nice little classifier / decision maker, I'm sure it has other uses...
Just the capacity to reliably emulate major functional regions of vertebrate brain already puts you on the threshold of creating big powerful nonhuman AI. If puploads come first, they'll be doing more than catching frisbees in Second Life.
The supercomputers will be there whether we like it or not. Some of what they run will be attempts at AI. This is so far the only approach that someone unaware of Friendliness issues has a high probability of trying and succeeding with (and not immediately killing us all)
Numerous Un-augmented accelerated uplaods is a narrow safe path, and one we probably won't follow, but it is a safe path. (so far one of 2, so it's important) I think the likely win is less than FAI, but the dropoff isn't so steep either as you walk off the path. Any safe AI approach will suggest profitable nonsafe alternatives.
An FAI failure is almost certainly alien, or not there yet. An augmentation failure is probably less-capable, probably not hostile, probably not strictly executing a utility function, and above all: can be surrounded by other, faster, uploads.
If the first pupload costs half a billion dollars and runs very slow, then even tweaking it will be safer than say, letting neural nets evolve in a rich environment on the same hardware.