Kaj_Sotala comments on Hedging our Bets: The Case for Pursuing Whole Brain Emulation to Safeguard Humanity's Future - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (244)
So, in this scenario we have obtained a big neural network that imprints on a master and can learn complex physical tasks... and we're just going to ignore the implications of that while we concentrate on trying to duplicate ourselves?
What's going to stop me from duplicating just the canine prefrontal cortex and experimenting with it? It's a nice little classifier / decision maker, I'm sure it has other uses...
Just the capacity to reliably emulate major functional regions of vertebrate brain already puts you on the threshold of creating big powerful nonhuman AI. If puploads come first, they'll be doing more than catching frisbees in Second Life.
I realize that this risk is kinda insignficant compared to the risk of all life on Earth being wiped out... But I'm more than a little scared of the thought of animal uploads, and the possibility of people creating lifeforms that can be cheaply copied and replicated, without them needing to have any of the physical features that usually elict sympathy from people. We already have plenty of people abusing their animals today, and being able to do it perfectly undetected on your home upload isn't going to help things.
To say nothing about when it becomes easier to run human uploads. I just yesterday re-read a rather disturbing short story about the stuff you could theoretically do with body-repairing nanomachines, a person who enjoys abusing others, and a "pet substitute". Err, a two-year old human child, that is.