soreff comments on Remind Physicalists They're Physicalists - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (76)
I feel a bit like I'm Eliezer expaining the instant failure modes of most AGI research (but not as smart), and that there could be a whole sequence of postings on the instant failure modes of explanations of consciousness.
Well, I don't think I can write those postings, or at least, devote the many days it would take me. Just some brief notes here amplifying the fallacies with examples.
A partial and unfinished explanation. But it must go some distance: it must suggest practical experiments and predict their results. (Thought experiments do not count.) Consider the four different fallacies I described by this standard:
Empty labels: saying consciousness is "the soul", "a spark of the divine within us", "self-awareness", etc. fails to constrain expectations.
Denying the existence of subjective experience: well, we do have it. At least, I do, and I've no reason to suppose I'm exceptional in this. (Those who seriously deny it might be exceptions in the other direction.) So this one has the virtue of constraining expectations but is instantly refuted by observation. It amounts to sticking one's fingers in one's ears and going "la la la can't hear you!" Arguments against the existence of subjective experience (consciousness, qualia, etc.) generally take the form of arguing against other people's arguments in favour. Since no-one has a good account of what it is, it is not difficult to demolish their bad accounts. This is like refuting the phlogiston theory to prove that fire does not exist.
In the p-zombie category is Minsky's "society of mind", which gives a hypothetical account of how a system might come to talk to itself about itself in the ways that we do. But how we talk about ourselves and how we feel about ourselves are two different things, and the latter is left unaddressed. Besides, there are plenty of computer systems that talk to themselves about themselves, and we see no reason to attribute consciousness to them. In the form in which Greg Egan expressed the theory in his story "Mr. Volition", consciousness is the piece of brain that does consciousness, just as the cerebellum is the piece of brain that does motor control. This is no better than any other homunculus theory: it is either passing the buck or asserting that we are all philosophical zombies, beings that talk about consciousness without having it.
Physical correlates: Neuroscience is always finding more and more physical correlates of mental phenomena, from the fact that gross lesions to various brain locations produce predictable patterns of cognitive impairment, to the results of live brain imaging during task performance. This is compelling evidence that the brain must be either the physical substrate of consciousness or an interface with something else. Neither alternative goes very far. We still don't know how the brain or anything else made of atoms could be a physical substrate for consciousness, however compelling the evidence that it is. Contrast this with the fact that we do know how ever-so-slightly impure silicon can be a substrate for computation. And the brain as an interface to something else fares even worse, as we have no idea what that something else could be. The soul? See (1).
So those are four basic ways in which attempts to explain consciousness can go wrong. I have yet to see an attempt that doesn't fail one or more.
I find this class of explanations plausible, myself. I find it at least imaginable that my "feeling" of consciousness basically is the stream of potential reports about myself that I could voice, if there were an interested listener to voice them to. To put it another way: Are you quite sure that the way we feel about ourselves isn't the same as the way we talk about ourselves (except for the inhibition of actual vocalization)? How would one show that the stream of potentially vocalized self-reports isn't consciousness? What would distinguish them?
I look around, and have visual experiences. These, it seems to me, are obviously different from any words I might say, or think but not say, about those experiences.
Good point! I might sketch a visual experience, but I don't ordinarily consider my visual experience to be a sequence of sketches, analogous to an ongoing interior monologue...