SilasBarta comments on Rationality quotes: August 2010 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (201)
This "Mary's Room" argument, like the "Chinese Room" argument†, contains a subtle sleight of hand.
On the one hand, for the learning to be about just the qualia rather than about externally observable features of vision processing, the subject would need to learn immensely more than the physical properties of red light. (The standard version of Mary's Room does so, postulating Mary to also deeply understand her own visual cortex and the changes it would undergo upon being exposed to that color.) In fact, the depth of conscious theoretical understanding that this would require is far beyond any human being, and it's wrong and silly to naively map our mind-states onto those of such a mind.
On the other hand, it plays on the everyday intuition that if I've never seen the color red, but have been given a short list of facts about it and am consciously representing my limited intuition for that set of facts, that doesn't add up to the experience of seeing red.
The equivocation consists of thinking that a superhuman level of detailed understanding of (and capability to predict) the human brain can be analogized to that everyday intuition, rather than being unimaginably other to it. So I don't see that an agent who was really possessed of that level of self-understanding would necessary feel that the actual experience added an ineffable otherness to what they already knew.
That sense of ineffable otherness, IMO, comes from the levels of detail in the mental processing of color which we don't have conscious access to. Our conscious mind isn't built to understand what we're doing when we visually perceive, at the level that we actually do it-- there's no evolutionary need to communicate all the richness of color perception, so the conscious mind didn't evolve to encompass it all. And this limitation of our conscious understanding feels to us like a thing we have which cannot in principle be reduced.
†The application of this same principle to the Chinese Room argument is a trivial exercise, left to the reader.
So we have no intuition for that understanding level's qualia? ;-)
Yeah, I realized the unintended recursion there, and have edited accordingly...