shminux comments on Timeless Identity - Less Wrong

23 Post author: Eliezer_Yudkowsky 03 June 2008 08:16AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (234)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: TheOtherDave 30 September 2013 05:32:15PM 1 point [-]

Your comment would make more sense to me if I removed the word "not" from the sentence you quote. (Also, if I don't read past that sentence of someonewrongonthenet's comment.)

That said, I agree completely that the kinds of vague identity concerns about cryonics that the quoted sentence with "not" removed would be raising would also arise, were one consistent, about routine continuation of existence over time.

Comment author: [deleted] 30 September 2013 06:37:14PM 0 points [-]

Hrm.. ambiguous semantics. I took it to imply acceptance of the idea but not elevation of its importance, but I see how it could be interpreted differently. And yes, the rest of the post addresses something completely different. But if I can continue for a moment on the tangent, expanding my comment above (even if it doesn't apply to the OP):

You actually continue functioning when you sleep, it's just that you don't remember details once you wake up. A more useful example for such discussion is general anesthesia, which shuts down the regions of the brain associated with consciousness. If personal identity is in fact derived from continuity of computation, then it is plausible that general anesthesia would result in a "different you" waking up after the operation. The application to cryonics depends greatly on the subtle distinction of whether vitrification (and more importantly, the recovery process) slows downs or stops computation. This has been a source of philosophical angst for me personally, but I'm still a cryonics member.

More troubling is the application to uploading. I haven't done this yet, but I want my Alcor contract to explicitly forbid uploading as a restoration process, because I am unconvinced that a simulation of my destructively scanned frozen brain would really be a continuation of my personal identity. I was hoping that “Timeless Identity” would address this point, but sadly it punts the issue.

Comment author: shminux 30 September 2013 11:00:59PM *  0 points [-]

I want my Alcor contract to explicitly forbid uploading as a restoration process, because I am unconvinced that a simulation of my destructively scanned frozen brain would really be a continuation of my personal identity.

Like TheOtherDave (I presume), I consider my identity to be adequately described by whatever Turing machine that can emulate my brain, or at least its prefrontal cortex + relevant memory storage. I suspect that a faithful simulation of just my Brodmann area 10 coupled with a large chunk of my memories would restore enough of my self-awareness to be considered "me". This sim-me would probably lose most of my emotions without the rest of the brain, but it is still infinitely better than none.

Comment author: TheOtherDave 01 October 2013 12:12:21AM 0 points [-]

Like TheOtherDave (I presume), I consider my identity to be adequately described by whatever Turing machine that can emulate my brain, or at least its prefrontal cortex + relevant memory storage.

There's a very wide range of possible minds I consider to preserve my identity; I'm not sure the majority of those emulate my prefrontal cortex significantly more closely than they emulate yours, and the majority of my memories are not shared by the majority of those minds.

Comment author: shminux 01 October 2013 12:53:14AM -1 points [-]

Interesting. I wonder what you would consider a mind that preserves your identity. For example, I assume that the total of your posts online, plus whatever other information available without some hypothetical future brain scanner, all running as a process on some simulator, is probably not enough.

Comment author: TheOtherDave 01 October 2013 02:18:51AM 0 points [-]

At one extreme, if I assume those posts are being used to create a me-simulation by me-simulation-creator that literally knows nothing else about humans, then I'm pretty confident that the result is nothing I would identify with. (I'm also pretty sure this scenario is internally inconsistent.)

At another extreme, if I assume the me-simulation-creator has access to a standard template for my general demographic and is just looking to customize that template sufficiently to pick out some subset of the volume of mindspace my sufficiently preserved identity defines... then maybe. I'd have to think a lot harder about what information is in my online posts and what information would plausibly be in such a template to even express a confidence interval about that.

That said, I'm certainly not comfortable treating the result of that process as preserving "me."

Then again I'm also not comfortable treating the result of living a thousand years as preserving "me."

Comment author: someonewrongonthenet 01 October 2013 03:03:07AM *  0 points [-]

a large chunk of my memories

You'll need the rest of the brain because these other memories would be distributed throughout the rest of your cortex. The hippocampus only contains recent episodic memories.

If you lost your temporal lobe, for example, you'd lose all non-episodic knowledge concerning what the names of things are, how they are categorized, and what the relationships between them are.

Comment author: TheOtherDave 01 October 2013 03:07:43AM 0 points [-]

That said, I'm not sure why I should care much about having my non-episodic knowledge replaced with an off-the-shelf encyclopedia module. I don't identify with it much.

Comment author: someonewrongonthenet 01 October 2013 03:30:51AM *  0 points [-]

If you only kept the hippocampus, you'd lose your non-recent episodic memories too. But technical issues aside, let me defend the "encyclopedia":

Episodic memory is basically a cassette reel of your life, along with a few personalized associations and maybe memories of thoughts and emotions. Everything that we associate with the word knowledge is non-episodic. It's not just verbal labels - that was just a handy example that I happened to know the brain region for. I'd actually care about that stuff more about non-episodic memories than the episodic stuff.

Things like "what is your wife's name and what does her face look like" are non-episodic memory. You don't have to think back to a time when you specifically saw your wife to remember what her name and face is, and that you love her - that information is treated as a fact independent of any specific memory, indelibly etched into your model of the world. Cognitively speaking, "I love my wife stacy, she looks like this" is as much of a fact as "grass is a green plant" and they are both non-episodic memories. Your episodic memory reel wouldn't even make sense without that sort of information. I'd still identify someone with memory loss, but retaining my non-episodic memory, as me. I'd identify someone with only my episodic memories as someone else, looking at a reel of memory that does not belong to them and means nothing to them.

(Trigger Warning: link contains writing in diary which is sad, horrifying, and nonfiction.): This is what complete episodic memory loss looks like. Patients like this can still remember the names of faces of people they love.

Ironically...the (area 10) might actually be replaceable. I'm not sure whether any personalized memories are kept there - I don't know what that specific region does but it's in an area that mostly deals with executive function - which is important for personality, but not necessarily individuality.

Comment author: TheOtherDave 01 October 2013 03:46:42AM 0 points [-]

I take it you're assuming that information about my husband, and about my relationship to my husband, isn't in the encyclopedia module along with information about mice and omelettes and your relationship to your wife.

If that's true, then sure, I'd prefer not to lose that information.

Comment author: someonewrongonthenet 01 October 2013 04:05:26AM *  1 point [-]

I take it you're assuming

Well...yeah, I was. I thought the whole idea of having an encyclopedia was to eliminate redundancy through standardization of the parts of the brain that were not important for individuality?

If your husband and my husband, your omelette and my omelette, are all stored in the encyclopedia, it wouldn't be a "off-the-shelf encyclopedia module" anymore. It would be an index containing individual people's non-episodic knowledge. At that point, it's just an index of partial uploads. We can't standardize that encyclopedia to everyone: If the the thing that stores your omelette and your husband went around viewing my episodic reel and knowing all the personal stuff about my omelette and husband...that would be weird and the resulting being would be very confused (let alone if the entire human race was in there - I'm not sure how that would even work).

(Also, going back into the technical stuff, there may or may not be a solid dividing line between very old episodic memory and non-episodoc memory

Comment author: TheOtherDave 01 October 2013 05:07:07AM *  0 points [-]

Sure, if your omelette and my omelette are so distinct that there is no common data structure that can serve as a referent for both, and ditto for all the other people in the world, then the whole idea of an encyclopedia falls apart. But that doesn't seem terribly likely to me.

Your concept of an omelette probably isn't exactly isomorphic to mine, but there's probably a parametrizable omelette data structure we can construct that, along with a handful of parameter settings for each individual, can capture everyone's omelette. The parameter settings go in the representation of the individual; the omelette data structure goes in the encyclopedia.

And, in addition, there's a bunch of individualizing episodic memory on top of that... memories of cooking particular omelettes, of learning to cook an omelette, of learning particular recipes, of that time what ought to have been an omelette turned into a black smear on the pan, etc. And each of those episodic memories refers to the shared omelette data structure, but is stored with and is unique to the uploaded agent. (Maybe. It may turn out that our individual episodic memories have a lot in common as well, such that we can store a standard lifetime's memories in the shared encyclopedia and just store a few million bits of parameter settings in each individual profile. I suspect we overestimate how unique our personal narratives are, honestly.)

Similarly, it may be that our relationships with our husbands are so distinct that there is no common data structure that can serve as a referent for both. But that doesn't seem terribly likely to me. Your relationship with your husband isn't exactly isomorphic to mine, of course, but it can likely similarly be captured by a common parameterizable relationship-to-husband data structure.

As for the actual individual who happens to be my husband, well, the majority of the information about him is common to all kinds of relationships with any number of people. He is his father's son and his stepmother's stepson and my mom's son-in-law and so on and so forth. And, sure, each of those people knows different things, but they know those things about the same person; there is a central core. That core goes in the encyclopedia, and pointers to what subset each person knows about him goes in their individual profiles (along with their personal experiences and whatever idiosyncratic beliefs they have about him).

So, yes, I would say that your husband and my husband and your omelette and my omelette are all stored in the encyclopedia. You can call that an index of partial uploads if you like, but it fails to incorporate whatever additional computations that create first-person experience. It's just a passive data structure.

Incidentally and unrelatedly, I'm not nearly as committed as you sound to preserving our current ignorance of one another's perspective in this new architecture.

Comment author: someonewrongonthenet 01 October 2013 09:04:39AM *  0 points [-]

I'm really skeptical that parametric functions which vary on dimensions concerning omelets (Egg species? Color? ingredients? How does this even work?) are a more efficient or more accurate way of preserving what our wetware encode when compared to simulating the neural networks devoted dealing with omelettes. I wouldn't even know how to start working on the problem mapping a conceptual representation of an omelette into parametric functions (unless we're just using the parametric functions to model the properties of individual neurons - that's fine).

Can you give an example concerning what sort of dimension you would parametrize so I have a better idea of what you mean?

Incidentally and unrelatedly, I'm not nearly as committed as you sound to preserving our current ignorance of one another's perspective in this new architecture.

I was more worried that it might break stuff (as in, resulting beings would need to be built quite differently in order to function) if one-another's perspectives would overlap. Also, that brings us back to the original question I was raising about living forever - what exactly is it that we value and want to preserve?

Comment author: shminux 01 October 2013 06:28:16AM -1 points [-]

Ironically...the (area 10) might actually be replaceable. I'm not sure whether any personalized memories are kept there - I don't know what that specific region does but it's in an area that mostly deals with executive function - which is important for personality, but not necessarily individuality.

What's the difference between personality and individuality?

Comment author: someonewrongonthenet 01 October 2013 09:29:20AM *  1 point [-]

In my head:

Personality is a set of dichotomous variables plotted on a bell curve. "Einstein was extroverted, charismatic, nonconforming, and prone to absent-mindedness" describes his personality. We all have these traits in various amounts. You can some of these personality nobs really easily with drugs. I can't specify Einstein out of every person in the world using only his personality traits - I can only specify individuals similar to him.

Individuality is stuff that's specific to the person. "Einstein's second marriage was to his cousin and he had at least 6 affairs. He admired Spinoza, and was a contemporary of Tagore. He was a socialist and cared about civil rights. He had always thought there was something wrong about refrigerators." Not all of these are dichotomous variables - you either spoke to Tagore or you didn't. And it makes no sense to put people on a "satisfaction with Refrigerators" spectrum, even though I suppose you could if you wanted to. And all this information together specifically points to Einstein, and no one else in the world. Everyone in the world a set of unique traits like fingerprints - and it doesn't even make sense to ask what the "average" is, since most of the variables don't exist on the same dimension.

And...well, when it comes to Area 10, just intuitively, do you really want to define yourself by a few variables that influence your executive function? Personally I define myself partially by my ideas, and partially by my values...and the former is definitely in the "individuality" territory.

Comment author: shminux 01 October 2013 04:49:14PM -1 points [-]

OK, I understand what you mean by personality vs individuality. However, I doubt that the functionality of BA10 can be described "by a few variables that influence your executive function". Then again, no one knows anything definite about it.