cousin_it comments on Three Approaches to "Friendliness" - Less Wrong

14 Post author: Wei_Dai 17 July 2013 07:46AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (84)

You are viewing a single comment's thread. Show more comments above.

Comment author: cousin_it 18 July 2013 10:13:53PM *  2 points [-]

Well, it's not a very strong desire, I suspect that many other people have much stronger "naturalistic" urges than me. But since you ask, I'll try to introspect anyway:

Curiosity doesn't seem to be the reason, because I want to leave the universe untouched even after I die. It feels more like altruism. Sometime ago Eliezer wrote about the desire not to be optimized too hard by an outside agent. If I can desire that for myself, then I can also desire it for aliens, give them a chance to not be optimized by us... Of course if there are aliens, we might need to defend ourselves. But something in me doesn't like the idea of taking over the universe in preemptive self-defense. I'd prefer to find some other way to stay safe...

Sorry if this sounds confusing, I'm confused about it too.

Comment author: Wei_Dai 19 July 2013 05:05:04AM 2 points [-]

That helps me to understand your position, but it seems unlikely that enough people would desire it strongly enough for CEV to conclude we should give up colonizing the universe altogether. Perhaps some sort of compromised would be reached, for example the FAI would colonize the universe but bypass any solar systems that contain or may evolve intelligent life. Would that be sufficient to satisfy (or mostly satisfy) your desire to not optimize aliens?