Gunnar_Zarncke comments on Preferences without Existence - Less Wrong

14 Post author: Coscott 08 February 2014 01:34AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (101)

You are viewing a single comment's thread.

Comment author: Gunnar_Zarncke 08 February 2014 03:09:04AM 1 point [-]

Reminds me of some discussions I had long ago.

The general principle was: Take some human idea or concept and drive it to its logical conclusion. To its extreme. The result: It either became trivial or stopped to make sense.

The reason for this is that sometimes you can't separate out components of a complex system and try to optimize them in isolation without losing important details.

You can't just optimize happyness. It leads to wireheading and that's not what you want.

You can't just optimize religious following. It leads to crussades and witch hunts.

You can't just maximize empathy. Harmless as that sounds. Humans can empathize with anything. There are monks that try avoid hurting bug (good that they didn't know of bacteria). Empathy driven to the extreme leads to empathy with other beings (here: simulated, even lied about, life forms) that don't match up with complex values.

Don't hurt your complex values.

Somewhere on the way from

  • your future self

  • your kin

  • your livestock

  • children

  • innocents

  • strangers

  • foreigners

  • enemies

  • the biosphere

  • higher animals

  • lower animals

  • plants

  • bacteria

  • hypothetical life forms

  • imaginary life forms

you should consider that your empathy diverged from being integrated well with your other values.

(yes, its not linear but a DAG)

Comment author: abramdemski 08 February 2014 07:01:20AM 3 points [-]

There are monks that try avoid hurting bug (good that they didn't know of bacteria)

These monks still exist. They have been informed.

Comment author: Gunnar_Zarncke 08 February 2014 10:42:58AM 1 point [-]

Sure they know now.

But when the monks belief structure formed they didn't know. Now that that is a given they incorporate that in a suitable compartment as the rest is obviously stable.

Comment author: abramdemski 10 February 2014 08:29:55AM 0 points [-]

They (not just the monks-- many of the ordinary practitioners) put filters on water faucets to drink as few bacteria as possible; don't eat root crops because harvesting them disturbs the soil too much; may refuse antibiotics; and in general, do everything they think is within reason to minimize killing.

There's probably some compartmentalization, but not a huge amount in that area.

Comment author: Gunnar_Zarncke 10 February 2014 07:12:42PM 1 point [-]

I take this as a piece of factual information. I do not assume that you want to imply some lesson with it.

Comment author: abramdemski 11 February 2014 12:55:15AM 1 point [-]

Yea, I'm just providing additional information because your model of the Jains seemed incomplete.

Jainism

Comment author: Gunnar_Zarncke 11 February 2014 10:39:39AM 0 points [-]

Very incomplete. I just relayed the anecdote about the monks to add color.

Interesting. Jains texts should be read by vegetarians to put them into perspective I guess.

Comment author: Squark 09 February 2014 07:15:24AM 0 points [-]

Coscott's philosophy is more or less orthogonal to the choice of empathy. E.g. a "Coscottist" might only care about here kin, but she will care more about versions of her kin embedded in simple universes.

Comment author: Coscott 08 February 2014 03:24:27AM 0 points [-]

Would you mind elaborating on why this reminded you of those discussions?

Is it because in the first half of the dialogue, I am following a chain where I am starting with a belief and slightly tweaking it little by little, and end up with a similar belief in a different circumstance?

Comment author: Gunnar_Zarncke 08 February 2014 04:16:53AM 0 points [-]

No. Because you explored the extremes of empathy toward beings.

You don't follow a path going from less to more extreme as I outlined but an extreme in different aspects you explore nonetheless.

Comment author: Coscott 08 February 2014 04:30:04AM 2 points [-]

Oh, ok, I get the connection now, thanks.

My main point was not that I care about non-existing things in any way that conflicts with cares about existing things. My point was that believing in the concept of existence is not necessary for having preferences. I suppose I would agree with

A: Hmm, I guess I want [happiness of non-existing agents] too. However, that is negligible compared to my preferences about things that really do exist.

If not for the fact that I don't think existence has any meaning.