Eliezer_Yudkowsky comments on Think Like a Supervillain - Less Wrong

26 Post author: Qiaochu_Yuan 20 February 2013 08:34AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (111)

You are viewing a single comment's thread. Show more comments above.

Comment author: Bugmaster 20 February 2013 03:58:52AM *  3 points [-]

Some of the more sophisticated supervillains do have noble goals, but suffer from nothing more than an imbalance of coefficients in their utility function. For example, a non-supervillain who wants to prevent nuclear war might undertake public awareness campaigns, invent anti-ICBM defence technologies, run for office in order to implement disarmament policies, etc. A supervillain would enslave humanity instead, then rule with a titanium fist, ruthlessly eradicating any humans whose actions could conceivably increase the probability of nuclear war.

EDIT: the paragraph below was changed in order to avoid running afoul of the commenting policy.

The interesting thing about such villains is that their methods are often highly effective, and thus, potentially entirely justifiable. Let's imagine that, after careful reflection and lots of Bayesian updates, you became 99.999...% certain that you could usher the world into a peaceful and prosperous future simply by unilaterally killing off a few troublemakers (super-powered or just super-nasty) with your laser-eyes. Well, that, and installing a Panopticon-grade surveillance system to ensure that you don't miss any troublemakers by accident. And, naturally, instituting a massive awareness campaign to reduce the chances of troublemakers arising. Would you be able to convince yourself to not do all of that ?

Comment author: Eliezer_Yudkowsky 20 February 2013 07:40:26AM -1 points [-]
Comment author: Bugmaster 20 February 2013 08:14:32AM 9 points [-]

I rewrote my comment to more closely comply with the policy; if you still feel it is in violation, go ahead and delete it (not that I need to tell you that, of course).

This said, I disagree that my original comment listed any "identifiable targets". The comment policy brings up "people with purple eye color" as an example of potentially acceptable fictional targets; IMO, the targets I listed are no more specific than that.

Comment author: Eliezer_Yudkowsky 20 February 2013 10:21:23AM 1 point [-]

Acceptable edit. Undeleted.