Eliezer_Yudkowsky comments on Great Product. Lousy Marketing. - Less Wrong

16 Post author: BenAlbahari 28 February 2010 09:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (70)

You are viewing a single comment's thread.

Comment author: Eliezer_Yudkowsky 01 March 2010 12:30:17AM 6 points [-]

Someone believes that the Singularity is a sack of absurdities and is sad about the fact that we're all deluded into believing it. To help pry us loose from our little cult, they post an argument that's really persuasive on a gut level: A photoshopped picture of me killing Meredith Kercher. (Shortly after, I am arrested by the Italian police.)

Is there a moral difference between that and what you're proposing besides, "Oh, but they're wrong and we're right?" If so, what do you think it is?

Comment author: Tyrrell_McAllister 02 March 2010 12:07:17AM *  5 points [-]

Is there a moral difference between that and what you're proposing besides, "Oh, but they're wrong and we're right?" If so, what do you think it is?

They have vastly different consequences. Why should a consequentialist seriously consider the possibility that there is no moral difference?

Comment author: BenAlbahari 01 March 2010 01:32:06AM 2 points [-]

To lay out the dark-arts debate a little, we can discuss:

  1. The underlying reasons why we dislike dark arts.
  2. Whether we should like dark arts. 2a. - Efficiency (essentially assuming utilitarianism) 2b. - Morality (essentially denying utilitarianism)
  3. Is there an "acceptable level of usage" (applies separately to 1, 2a, and 2b).

So you're asking about 2b and 3.

I'll make another comment to dive into that specific path.

Comment author: Vladimir_Nesov 01 March 2010 01:32:38AM 4 points [-]

Is there a moral difference between that and what you're proposing besides, "Oh, but they're wrong and we're right?"

That's quite an important difference.

Comment author: jimrandomh 01 March 2010 12:55:02AM *  1 point [-]

Yes, fabricating evidence of a murder is morally worse than almost any other type of lie.

Comment author: JGWeissman 01 March 2010 05:09:58AM *  5 points [-]

Ok, here is a different example not framing anyone for murder:

Someone believes that cryonics could not possibly work, and uses the dark arts to convince people already signed up not to go through with it, effectively killing them (though the persuader does not believe this, and in their expectations, have produced only good effects).

Comment author: loqi 01 March 2010 05:03:19PM 4 points [-]

Sadly, the scenario you describe is very realistic.

Comment author: BenAlbahari 01 March 2010 02:23:34AM *  0 points [-]

Stripping each of the two examples down to the point where all you have left to compare them with is the principle of "ends justifies the means", then sure, they're the same. If our categorical imperative was "the ends never justifies the means" then we could stop gathering information. However, I think the specific means and specific ends matter.

You've constructed your example - or in any case could clearly construct such an example - such that the value of the end in both examples is equivalent from the perspective of the person conducting dark arts. However, the, means are clearly different. Framing someone for murder is far worse. That's the moral difference. If you changed the example to radically reduce the heinousness of the means, then I think the moral case is equivalent in both examples, from the perspective of the person conducting the dark arts.

My final thought is that there's a grand hidden "ethical prior" that we're ignoring here. Regardless of the particular end in question, we should take into account the degree to which rational processes were used to justify that end. We can legitimately claim the moral high ground if the opposing side fails to provide any rational justification for the end they are promulgating.