You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

fubarobfusco comments on Open thread, August 19-25, 2013 - Less Wrong Discussion

2 Post author: David_Gerard 19 August 2013 06:58AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (325)

You are viewing a single comment's thread. Show more comments above.

Comment author: fubarobfusco 25 August 2013 11:37:53PM 0 points [-]

Does it matter to you that octopuses are quite commonly cannibalistic?

Comment author: Eliezer_Yudkowsky 26 August 2013 01:05:31AM 5 points [-]

No. Babyeater lives are still important.

Comment author: shminux 26 August 2013 03:11:48AM 1 point [-]

I was unable to empathize with this view when reading 3WC. To me the Prime Directive approach makes more sense. I was willing to accept that the Superhappies have an anti-suffering moral imperative, since they are aliens with their alien morals, but that all the humans on the IPW or even its bridge officers would be unanimous in their resolute desire to end suffering of the Babyeater children strained my suspension of disbelief more than no one accidentally or intentionally making an accurate measurement of the star drive constant.

Comment author: Viliam_Bur 31 August 2013 12:10:07PM 1 point [-]

To me the Prime Directive approach makes more sense.

As an example outside of sci-fi, if you see an abusive husband and a brainwashed battered wife, the Prime Directive tells you to ignore the whole situation, because they both think it's more or less okay that way. Would you accept this consequence?

Would it make a moral difference if the husband and wife were members of a different culture; if they were humans living on a different planet; or if they belonged to a different sapient species?

Comment author: shminux 31 August 2013 06:52:26PM 0 points [-]

The idea behind the PD is that for foreign enough cultures

  • you can't predict the consequences of your intervention with a reasonable certainty,

  • you can't trust your moral instincts to guide you to do the "right" thing

  • the space of all favorable outcomes is likely much smaller than that of all possible outcomes, like in the literal genie case

  • so you end up acting like a UFAI more likely than not.

Hence non-intervention has a higher expected utility than an intervention based on your personal deontology or virtue ethics. This is not true for sufficiently well analyzed cases, like abuse in your own society. The farther you stray from the known territory, the more chances that your intervention will be a net negative. Human history is rife with examples of this.

So, unless you can do a full consequentialist analysis of applying your morals to an alien culture, keep the hell out.

Comment author: MugaSofer 26 August 2013 05:18:02PM 0 points [-]

Funny, I parsed that as "should we then maybe be capturing them all to stop them eating each other?"

Didn't even occur to me that was an argument about extrapolated octopus values.

Comment author: Eliezer_Yudkowsky 26 August 2013 07:38:42PM 2 points [-]

It wasn't, your first parse would be a correct moral implication. The Babyeaters must be stopped from eating themselves.

Comment author: MugaSofer 26 August 2013 09:36:18PM 0 points [-]

... whoops.

I meant I parsed fubarobfusco's comment differently to you, ("they want to be cannibals, therefore it's ... OK to eat them? Somehow?"), because I just assumed that obviously you should save the poor octopi (i.e. it would "bother" you in the sense of moral anguish, not "betcha didn't think of this!")