Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

lessdazed comments on Nonperson Predicates - Less Wrong

29 Post author: Eliezer_Yudkowsky 27 December 2008 01:47AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (175)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: lessdazed 17 November 2011 03:11:05PM 0 points [-]

Questioning the purpose of the war is suppressed

So they would naturally feel differently about fighting in wars with different causes and justifications? If not, why suppress it?

non-productive impulses like art, scientific curiosity, or socializing.

If they have desires to do these things then the reason they were created may have been to fight, but this is not their "only purpose" from their perspective.

Comment author: TimS 17 November 2011 03:47:08PM 0 points [-]

Yes, what's immoral is the shoehorning. They would think that there is more to life than what they do, if only they were allowed freedom of thought.

One might think that it is possible to create human-level intelligence creatures that won't think that way. But we've never seen such a species (yes, very small sample size), and I'm not convinced it is possible.

Comment author: ArisKatsaris 17 November 2011 04:07:17PM 2 points [-]

So in short you aren't talking about a race of supersoldiers whose only purpose is really to fight wars for us, you're talking about a race of supersoldiers who are pressured into believing that their only purpose is to fight wars for us, against their actual inner natures that would make them e.g. peaceful artists or musicians instead.

At this point, we're not talking about remotely the same thing, we're talking about completely opposite things -- as opposite as fulfilling your true utility function and being forced to go against it -- as opposite as Fun and Anti-Fun.