Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

turchin comments on Superintelligence via whole brain emulation - Less Wrong Discussion

9 Post author: AlexMennen 17 August 2016 04:11AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (28)

You are viewing a single comment's thread. Show more comments above.

Comment author: turchin 17 August 2016 05:42:06PM *  0 points [-]

Unless it self-modifies to the point where you're stretching any meaningful definition of "human"

Its evolution could go wrong from our point of view, but older generation always thinks that younger ones are complete bastards. When I say "natural evolution" I meant complex evolution of values based on their previous state and new experience, and it is rather typical situation for any human being who's values are evolving from childhood, and also under influence of experiences, texts and social circle.

This idea is very different from Hanson's em world. Here we deliberately upload only one human, who is trained to become are a core of future friendly AI. He knows that he is going to make some self-improvements but he knows dangers of unlimited self-improvement. His loved ones are still in flesh. He is trained to be not a slave as in the Hanson's Em world, but a wise ruler.