You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

DanielLC comments on Ideas wanted: democracy in an Em world - Less Wrong Discussion

1 Post author: Stuart_Armstrong 06 June 2013 02:05PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (64)

You are viewing a single comment's thread. Show more comments above.

Comment author: DanielLC 07 June 2013 09:09:56PM 0 points [-]

Ems are psychologically human. If you ask how a human would act in situation X vs. how an em would act in situation X, the answer is the same.

Comment author: Barry_Cotter 09 June 2013 08:00:03AM -2 points [-]

And? Psychopaths are alien enough for me to have at best minor compunctions about wholesale annihilation and they're a lot closer to me than say, uplifted dogs on most dimensions. Them,I could see communion with. Absent a Singleton a subjective EM century will suffice for things to reach "Nuke them from orbit, it's the only way to be sure."

Comment author: wedrifid 09 June 2013 04:09:40PM *  5 points [-]

Psychopaths are alien enough for me to have at best minor compunctions about wholesale annihilation

You have at best minor compunctions about wholesale annihilation of an entire group of humans because you are too different to a psychopath? There's some irony!

Note that this site has something of an official policy against discussion of hypothetical violence against identifiable people or groups. As far as I know there is no "except, you know, psychopaths, those @#%#s have it coming" exception in place. Incidentally of all the groups of actual humans one could discuss the wholesale annihilation of, psychopaths are among the least safe target to threaten in practical terms. Psychopaths will tend to have fewer compunctions when it comes to casual execution of pre-emptive self defence measures.

Comment author: Barry_Cotter 10 June 2013 01:21:52AM 0 points [-]

If I can play iterated prisoners dilemma with it and our terminal values are not at odds let's trade. I have recent second hand exposure to one psychopath fucking a friend of mine over. It has left me with a much more visceral comprehension of the fact that some people are fucking evil than I had previously. And of conformity and victim blaming.

I'm going to retract the comment as ableist and because as you pointed out genocide is wrong.

A possibly rude question follows. Do you or have you had friendly relations with anyone you recognised was a psychopath? If so how, why?

Comment author: wedrifid 10 June 2013 04:56:03AM 0 points [-]

A possibly rude question follows. Do you or have you had friendly relations with anyone you recognised was a psychopath? If so how, why?

A high functioning psychopath, sure. I blame people for what they in fact do, not which parts of their brain are active when they do so. My own visceral comprehension of human evil is such that I don't see much tangible practical difference between high functioning instrumentally rational psychopaths and normal particularly high status humans. In fact since the main difference can be that the psychopath has had to become self aware of their own hypocrisy.

Comment author: DanielLC 09 June 2013 10:02:21PM *  0 points [-]

So your saying that values drift will make them less human as they age?

I suspect that either it wont, or it will make them so crazy that just leaving them is hardly an option. Hopefully, they'd develop some way to keep them sane.

Comment author: Barry_Cotter 10 June 2013 01:30:39AM 0 points [-]

What's sane? That's socially constructed. What's good at reproducing, at getting more resources? That is not. Absent some mechanism to keep values from drifting ems will experience massive, swift value drift. This will be the case even if they stay within the space of current human neurological diversity, which they won't.

The only way the future isn't a hardscrabble hell is with a friendly Singleton.

Comment author: DanielLC 10 June 2013 01:54:51AM 0 points [-]

I'd say absent some mechanism to keep them sane, an old enough EM couldn't even be considered intelligent, and would only be a danger to the rest of us in that it's a resource drain if we can't stomach euthanasia.

We may or may not naturally have such a mechanism.

By "current human neurological diversity" do you mean staying within what we now consider a sane human (in which case values drift will be limited to what a sane human would value), or do you mean that they're not modding their mind?

My opinion is the same for if you mean that EMs are modding themselves, except for the part about that there might be a built-in mechanism for keeping them sane.