RichardKennaway comments on Rationality Quotes: July 2010 - Less Wrong

4 Post author: komponisto 01 July 2010 09:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (216)

You are viewing a single comment's thread.

Comment author: RichardKennaway 02 July 2010 06:50:00AM 14 points [-]

Silas will like this one:

Menahem sighed. 'How can one explain colours to a blind man?'

'One says', snapped Rek, 'that red is like silk, blue is like cool water, and yellow is like sunshine on the face.'

-- David Gemmell "Legend"

Comment author: SilasBarta 02 July 2010 05:30:41PM *  19 points [-]

I was actually starting another article that presents a solution (well, a research program) for qualia. [1] The idea is this:

The concept of qualia becomes mysterious when we have a situation in which sensory data (edit: actually, cognition of the sensory data) is incommensurable (not comparable) between beings. So the key question is, when would this situation arise?

If you have two identical robots with idential protocols, you have no qualia problem. They can directly exchange their experiences and leave no question about whether "my red" is "your red".

But here's the kicker: imagine if the robots don't use identical protocols. Imagine that they instead simply use themselves to collect and retain as much information about their experiences as physically possible. They optimize "amount I remember".

In that case, they will use every possible trick to make efficient use of what they have, no longer limited by the protocols. So they will eventually use "encoding schemes" for which there is no external rulebook; the encoding is implicitly "decompressed" by their overall functionality. They have not left a "paper trail" that someone else can use and make sense of (without significant reverse engineering effort).

In that case, you can no longer directly port one's experience over into the other's. To each other, the encoding looks like meaningless garbage. But if they're still alive, they can still achieve some level of commensurability. They can look at the same uniform surface and ask each other, "how does your photo-modality respond to this thingamajig?" [2] They can then synchronize internal experiences across each other and have a common conception of "red", even as it still may differ from what exactly the other robot is doing internally upon receiving red-data.

(And they can further constrain the environment to make sure they are talking about the same thing if e.g. one robot has tightly-coupled sensory cognition in which sensation of color varies with acoustics of the environment.)

This, I claim, is the status of humans with respect to each other: We have very similar general "body plans" but also use a no-holds-barred, standards-free method for creating (encoding) memories that puts up a severe -- but partially circumventable -- barrier to comparing internal experiences.

(Oh, and since you guys are probably still wondering: even I wouldn't fault you for failing to explain color a blind man. The best I would expect is that you can say, "Alright, you know how smelling is different from hearing? Well, seeing is as different from both of those as they are from each other.")

[1] Yes, I start a lot of articles but don't finish them ... have about three times as many in progress as I have posted.

[2] Remember: even though they have different internal experiences, they can still tell that a particular observation depends on a particular sensor by turning it on and off, and thus meaningfully talking about how their cognition relates to a particular sensor.

Comment author: JenniferRM 04 July 2010 12:39:30AM 8 points [-]

Before finishing (or perhaps as a sequel?) you should make sure to watch Cristof's Koch's "neural correlates of consciousness" talk. He's been giving variations on this talk for something like 10 years that I know of and its pretty polished. Its gotten better over the years and the speaker is the source of my current working definition of consciousness (quoted below). Which is not about language I/O and compression but about internal experiences themselves and what systems implement them.

The core insight is that you can show someone a visual trick (like the faces or goblet image) and you can go back and forth "seeing different interpretations". When you're in one or the other state "internal state" this is you having different kinds of "qualia", and presumably these distinct perceptual states have "biological correlates".

Manipulation of these internal mental states and study of the associated physical systems become the "object of study" in order to crack the mind-body problem. Once you've got the neural level you can ask about high level issues like algorithms or ask about deeper mechanisms like neurotransmitters and genes and so on. Full understanding would imply that we could create mutant "zombie mice" and that they would have no qualia (of certain sorts) and be incapable of whatever behavior was "computed" in a way that involved (that sort of) qualia.

Ideally we would have a theory to predict and and explain such phenomenon and perhaps we'd be able to invent things like a pill that lets you "become a p-zombie" for an hour (though I suspect part of that would involve shutting down enough memory formation processes that you would not be able to remember the experience except via something external like videotape).

The Q&A has much more sophisticated objections/questions than you usually get on the subject of minds. The final question ends with Koch's working theory which sounds about right to me. Quoting Koch when asked why he thinks bees are probably conscious and why he became vegetarian:

Rather than endless speculation there has to be some complex behavior, so forget about plants or even simple single celled organisms. If they do very simple stereotypical things I see no reason to ascribe consciousness to them. This may be wrong ultimately, but I think right now that's my index for consciousness: reasonably complex, non-stereotypical behavior that involves online dynamic storage of information.

Comment author: SilasBarta 05 July 2010 11:25:40PM 2 points [-]

Thanks for the pointer! This will help me to connect my speculations to the existing literature.

Any text version/transcript of this lecture, or paper that explains the points in the talk?

Comment author: JenniferRM 06 July 2010 03:22:24AM 0 points [-]

My summary above cuts to what I think is the core insight about focusing clearly and experimentally on exactly the elements of interest: consciousness and neurons. The talk itself is a summary of the main points of many papers with different points and some demonstrations of the experimental manipulations.

The talk itself (rather than the intros) starts about 4 minutes in. I recommend just watching it. Koch is a pretty good speaker and this is sort of his "dog and pony show" where he summarizes an entire research program in a way that's been iteratively optimized for years. Your 60 minutes will not be wasted :-)

Comment author: Oscar_Cunningham 02 July 2010 05:40:39PM *  1 point [-]

Up voted, looking forward to you posting some of these in-progress articles. Should:

three times as many posted as I have in progress.

Be vice-versa?

Comment author: SilasBarta 02 July 2010 05:43:58PM 0 points [-]

Thanks! And yes it should, I'll correct that.

Comment author: WrongBot 02 July 2010 07:38:32PM 0 points [-]

This seems to match up with an argument I made against writing oneself into the future, though I think your formulation is more general. I'm certainly quite interested in hearing more on the subject; I think you're headed in a good direction.

Comment author: SilasBarta 03 July 2010 02:06:13AM *  2 points [-]

Thank you much, and I definitely see the similarity with what you posted.

I may indeed be running into the problem of letting "good enough" become the enemy of "at all". I'll try to get these articles up in some presentable form soon.

Comment author: cousin_it 05 July 2010 01:01:30PM *  1 point [-]

The drafts you've been posting lately are interesting to me, and I'd like to see them fleshed out into top-level posts. I would also suggest adding external material and references to give more context to your thought experiments.

Comment author: SilasBarta 05 July 2010 05:20:22PM *  0 points [-]

Thanks. But that's one of my difficulties. I read a lot of stuff and so these ideas just "come together". I don't even know if there is a source that agrees with this idea. As it stands now, the only sources I believe I'd be able to cite are some of Gary Drescher's discussion of qualia, and the information-theoretic basics of how compression works, and what makes it more or less effective.

Any suggestions (specific suggestions) for how to find the external references that would be relevant to this topic or the other one's I've posted recently?

By the way: I started keeping a list of planned top-level articles on my Wiki page.

Comment author: NihilCredo 02 July 2010 01:48:41PM 1 point [-]

I 'get' the other two, but the red-silk analogy eludes me.

Comment author: RichardKennaway 02 July 2010 02:08:42PM 2 points [-]

I have heard of a blind man comparing red (as he had heard of it) to the sound of a trumpet.

Comment author: NihilCredo 02 July 2010 02:11:55PM *  0 points [-]

Hmm... can a blind man possess synæsthesia? It seems possible if the source of the blindness is in the eye rather than the brain.

Comment author: Jonathan_Graehl 02 July 2010 04:02:32PM *  3 points [-]

More likely color-words as concepts exist in the brains of blind people because there are interestingly different distributions of other directly meaningful concepts associated in proximity with others' usage of the color-words, and with actual objects in the world (presuming that their color is sometimes described to you).

I think Richard put this very well when he said "as he had heard of it".

Comment author: Blueberry 04 July 2010 01:28:01AM 1 point [-]

Probably. A color-blind person can.

Comment author: Blueberry 02 July 2010 04:19:01PM 1 point [-]

Me too. Silk is more like beige or cream color. How can you describe red without talking about fire?

Comment author: KrisC 03 July 2010 11:07:52PM 3 points [-]

Or this infographic from Information is beautiful.

The texture of silk is smooth and easily slips from the grasp. It is exciting and sensuous as a fabric. Anger, courage, love, heat, and passion, according to the chart.

Perhaps it might be easier to read them the referenced chart's correspondences.

Comment author: twanvl 03 July 2010 11:29:09PM 7 points [-]

That infographic would have been much better as a regular table, instead of this circular thing. It seems to me as if it is not intended to be actually used, only to look nice.

Comment author: RichardKennaway 04 July 2010 08:55:44AM 8 points [-]

It's a dreadful graphic. No information leaps out at the viewer, you have to hunt through two tables for the meanings of the letters and numbers. It takes an effort to find the letter for any given block, or to find the block for any given letter, in radii far from where the letters appear. It's difficult to tell apart yellow and gold, or grey and silver: the key only serves to highlight how indistinguishable the colours are.

And since this graphic does not work, I cannot see it as beautiful. It is an ugly sacrifice of function to superficial prettiness.

Comment author: cupholder 04 July 2010 11:22:18AM *  1 point [-]

Agreed. I wish they'd stick to calling hard-to-read graphics like this 'visualizations' - the word 'infographics' implies a graphic designed to efficiently display information.

The worst part is it wouldn't be hard to improve the graphic. They could drop the annoying 84-item list and just directly write the emotions in the 84 slots around the circle instead of using numbers. Enlarge the circle and blow up the font size a bit - then they can put the A to J list of cultures into the empty middle of the circle so you don't have to keep looking off the side to cross-reference it. That'd help, even if it wouldn't fix it.

Edit - I see that when they used that infographic as their book's cover, they gave up on the idea of making it a real infographic and just made it into a pretty flower!

Comment author: Blueberry 04 July 2010 01:25:30AM 0 points [-]

So looking at numbers 31, 2, and 46, a friendly AI should be orange and blue...

The texture of silk is smooth and easily slips from the grasp. It is exciting and sensuous as a fabric. Anger, courage, love, heat, and passion, according to the chart.

I don't associate red with smoothness, or silk with any of those emotional qualities.

Comment author: wedrifid 04 July 2010 02:49:00AM 2 points [-]

I don't associate red with smoothness, or silk with any of those emotional qualities.

Are you sure about that? Your emotions don't ask you for permission before they make associations.

Comment author: Blueberry 04 July 2010 04:53:19AM 0 points [-]

I can't tell if this is wordplay based on the ambiguity in the quoted sentence (in which case, I like the joke :) ) or if you're serious. If you're serious, then yes, I'm sure: while emotions may not ask me for permission, I'm aware of what they're associated with.

Comment author: red75 04 July 2010 08:09:27AM 0 points [-]

Strange. I have associations for green (foliage, leafs), yellow (sun), blue(water). Red requires conscious effort to select domain for association to pop up.

Comment author: JenniferRM 03 July 2010 10:42:42PM *  1 point [-]

Or blood?