Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Daniel_Burfoot comments on The map of agents which may create x-risks - Less Wrong Discussion

2 Post author: turchin 13 October 2016 11:17AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (6)

You are viewing a single comment's thread.

Comment author: Daniel_Burfoot 15 October 2016 03:32:41PM 0 points [-]

Cool chart.

I noticed that you wrote "not soon" for the likelihood of Value Drift. I think Value Drift is a very real possibility, maybe an inevitability.

Look back a couple of hundred years from the present; you'll find that the values of the people at that time were incomprehensibly, unmistakably different. Religion was of paramount importance; it was considered acceptable or obvious that some races were superior to others; people accepted the notion of hereditary aristocracy, and so on.

Based on the historical record, I predict that the values of humans and human civilization 300 years from now will be unrecognizably different from modern Western 21st century values. The question is: is that a problem? I personally don't care that much, but I'm unlike most other LWers in that I'm not very interested in optimizing the region of spacetime outside of my own small bubble.

Comment author: turchin 15 October 2016 08:33:45PM 2 points [-]

I think that natural evolution of values is part of what is to be human (and that is why I am against CEV). But here I mean some kind of disruptive revolutions in values in shorter time period, like in 20 years. And I think it will not in happen in 20 years as humans have some kind of values inertia.

But on loner time horizon new technologies could help to spread new "memes-values" quicker, and they will be like computer viruses for human brains, may be disseminating through brain implants. It could be quick and catastrophic.