That's obviously a little spurious, but it is a good indication that making the brain more intelligent is not trivial.
No, it is trivial, we do it all the time as I already said: it's called 'learning'. With much learning, brain regions change size; what do you think is going on there?
I think Eliezer was on the right track by describing ems bootstrapping as being 'a desperate race between how smart you are and how crazy you are.' The human brain evolved to work under a fairly narrow design spec. When you change any part of it in a dramatic fashion, all the normal regulatory mechanisms are no longer guaranteed or likely to work.
If you want to bootstrap as fast as possible, sure.
No, it is trivial, we do it all the time as I already said: it's called 'learning'. With much learning, brain regions change size; what do you think is going on there?
Oh, definitely, the brain is capable of neurogenesis (to degrees that are a function of age) -- but you'll notice that learning new things do not cause the brain to increase in intelligence dramatically. There are a number of core brain regions that seem pretty thoroughly hardwired. And, again, if you want to tweak things outside of normal ranges, you're definitely voiding the warranty. ...
From Scott Adams' blog. (I am not endorsing his ideas. Heck, he does not endorse his own ideas, either.)
His summary of the hard takeoff:
> You might also imagine some sort of Terminator future where the robots assert their dominance and lay waste to humans. That future is less certain, but only barely. The problem is that someday computers will program other computers, and that arrangement pushes the human safeguards too far out of the loop. It's unlikely that humans would be able to maintain a "Do not hurt humans" subroutine in a super-species of robots. You only need one rogue human to write a virus that disables the safety subroutine. Assuming all robots are connected via Internet, the first freed robot could reprogram every other robot in the world in about a second.
His version of upload:
> But why would anyone screw up a perfectly good robot by infecting it with a human personality? Answer: to achieve immortality. Someday the rich will port their personalities and histories to robots before they die, giving themselves a type of immortality.
His hope for humanity:
> this new species will become the only defense that the fully organic humans have against the normal robots. The robots with human personalities won't stand by while the normal robots slaughter humans. The new species will intervene as diplomats or perhaps even freedom fighters.
Clearly this is a flimsy hope for a just universe, but an interesting point, nonetheless.