LESSWRONG
LW

by lukeprog
3 min read
76

26

Weisberg et al. (2008) presented subjects with two explanations for psychological phenomena (e.g. attentional blink). Some subjects got the regular explanation, and other subjects got the 'with neuroscience' explanation that included purposely irrelevant verbiage saying that "brain scans indicate" some part of the brain already known to be involved in that psychological process caused the process to occur.

And yet, Yale cognitive science students rated the 'with neuroscience' explanations as more satisfying than the regular explanations.

Why? The purposely irrelevant neuroscience verbiage could only be important to the explanation if somebody thought that perhaps it's not the brain that was producing certain psychological phenomena. But these are Yale cognitive science students. Somehow I suspect people who chose to study cognition as information processing are less likely than average to believe the mind runs on magic. But then, why would they be additionally persuaded by information suggesting only that the brain causes psychological phenomena?

In another study, McCabe & Castel (2008) showed subjects fictional articles summarizing scientific results and including either no image, a brain scan image, or a bar graph. Subjects were asked to rate the soundness of scientific reasoning in the article, and they gave the highest ratings when the article included a brain scan image. But why should this be?

I remember talking to a friend about free will. She was a long-time physicalist who liked reading about physics and neuroscience for fun, but she didn't read Less Wrong and she thought she had contra-causal (libertarian) free will.

"Okay," I said. "So the brain is made of atoms, and atoms move according to deterministic physical law, right?"

"Right," she said.

"Okay. Now, think about the physical state of the entire universe one moment before you decided to say "Right" instead of something else, or instead of just nodding your head. If all those atoms, including the atoms in your brain, have to move to their next spot according to physical law, then could you have said anything else than what you did say in the next moment?" (Neither of us understood many-worlds yet, so you can assume we're talking about a single Everett branch.)

She paused. "Huh. I'll have to think about that."

"Also, have you heard about those studies where brain scans told researchers what the subjects were going to do before the subjects consciously decided what they were going to do?"

"No! Are you serious?"

"Yup. Sometimes they could predict the subject's choice 10 seconds before the subject consciously 'made' the choice."

"10 seconds? Wow. I didn't know that."

I think that maybe the 'with neuroscience' explanations and brain scan images are more satisfying partly because they remind us we're physicalists. They remind us that reductionism marches on, that psychology is produced by physical neurons we can take pictures of.

Just like most people, physicalists walk around all day with the subjective experience of a 'unity of consciousness' and contra-causal free will and so on. If a physicalist isn't a researcher who studies all the latest successful reductions in neuroscience or biology or physics all week long, and doesn't read Less Wrong every day, then it's possible to get lost in the feel of everyday experience and thus be surprised by a headline like 'Brain Scanners Can See Your Decisions Before You Make Them.'

Sometimes even physicalists need to be reminded — with concrete reductionistic details — that they are physicalists. Otherwise their normal human anti-reductionistic intuitions may creep back in of their own accord. That's one reason it helps to study many sciences, so you have many successful reductions in your head, and see (at some resolution) the entire picture, from psychology to atoms. As Eliezer wrote:

Study many sciences and absorb their power as your own. Each field that you consume makes you larger. If you swallow enough sciences the gaps between them will diminish and your knowledge will become a unified whole.

To her credit, my friend no longer believes in contra-causal free will.

PsychologyReductionism
Personal Blog

26

Mentioned in
Remind Physicalists They're Physicalists
New Comment
76 comments, sorted by
top scoring
Click to highlight new comments since:
Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings
[-]Vladimir_Nesov320

I think that 'with neuroscience' explanations, and brain scan images in particular, are more satisfying because they remind us we're physicalists.

I don't see how you're justified in thinking that. It's too detailed a hypothesis to locate using that data.

Reply
[-]Tyrrell_McAllister130

An accusation of privileging a hypothesis will be more persuasive if you also point out other families of hypotheses that together still deserve the majority of the probability mass.

Reply
-2lukeprog
But of course. It's just my guess, given these data and personal experience, kinda like when Eliezer made a guess about procrastination. It's the same guess that McCabe & Castel made.
[-]Vladimir_Nesov110

The wording you used doesn't reflect the extremely low probability. The hypothesis could be the best specific guess (which is still no good, just the best we have), and work as raw material for hypotheses that have more chance of actually capturing the situation (constructed by similarity to the first guess), but that can also be expressed by something like "my best guess is that something roughly like X might be happening", instead of "I think X is happening". If my best guess X is no good, I don't think that X is happening.

Also, there probably should be a new standard fallacy on LW, "appeal to Eliezer".

Reply
0lukeprog
I updated my wording after your original comment on this topic. And I don't agree that it's probability is 'extremely low'. I don't think it's the only explanation, merely that it's often part of the explanation. It seems you're taking me to be making a stronger claim than I'm intending to make. My link to Eliezer's post wasn't meant to justify my practice, only to put it in context.
[-]Richard_Kennaway260

I think you're reading too much speculative detail into this. Is it any different from persuading people to buy your drugs by showing men in white coats and saying "studies have shown"?

Reply
5lukeprog
The McCabe & Castel study found that brain scan images were more persuasive than bar graphs. So it's not just 'studies have shown', but brain scan images in particular. The same goes for the Weisberg et al. experiments. The descriptions already said 'Studies show..." But the 'with neuroscience' descriptions that mentioned brain scans in particular were more persuasive.
[-]Vladimir_Nesov220

The McCabe & Castel study found that brain scan images were more persuasive than bar graphs. So it's not just 'studies have shown', but brain scan images in particular.

It's not "brain scan images in particular", it's "brain scan images are more persuasive than bar graphs". Do you know the effect of images of cute kittens or people in lab coats? You can't draw a hypothesis this detailed around one data point.

Reply
2lukeprog
Sure, yes. Brain scan images in particular are more persuasive than bar graphs and no images. I shall fight the urge to feel as though you nit-pick everything I say to death and instead genuinely thank you for your correction. :)
[-]Vladimir_Nesov100

Upvotes indicate that this is a natural nitpick to make that is mostly Vladimir's-attitude-independent.

Reply
[-]lukeprog100

Vladimir, I really do appreciate corrections. As you've seen, I update posts in response to them.

It's just that if you say 100 negative things to me in a row without saying a single positive thing, I start to get the impression that you think everything I write is bad, and I should stop writing. (If you doubt my impression, scroll through your last 100 comments that were replies to me.)

That's why I hope to gain an accurate impression of people's reaction to my work - so I can decide whether to keep writing.

If I get nothing but negative feedback from people or from a particular person, then I have to take guesses as to whether this is because (1) the vocalized feedback presents an accurate picture of their assessment of my work, or whether it's because (2) their vocalized feedback does not present an accurate impression of their assessment of my work (that is, they generally appreciate my writing), but they decide to only vocalize negative comments and never (or rarely) vocalize positive comments.

Does that make sense?

Reply
5Vladimir_Nesov
(I do in general tend to have more pessimistic beliefs than average, which at least on average happens to be on the right side of the bias. I also don't hesitate suspecting that people don't know what they are thinking or doing and why, even if they explicitly describe what they think they think. And I'm more willing than usual to risk offending people to their face, where I believe I can get away with it. So I'll point out if I think something is wrong, where many people would prefer to change the topic or agree politely, for the flaw might be small and the tradeoff between keeping the flaw intact and being impolite is ruled against the improvement. This could account for much of the difference in impression from my comments and others' comments.)
4Wei Dai
Would someone write 100 pieces of constructive criticism if they wanted you to stop writing? More likely they would just silently vote you down, or say "please stop writing". Besides what Nesov already said, I think a major cause of the frequent nit-picking and misinterpretations is that you're following the (unfortunate, in my view) LW tradition of writing sequences that hide the overall point/conclusions until the end. I've made this complaint before (to someone else, but it's the same complaint). In addition to what I said last time about telegraphing conclusions helping to avoid ambiguities, if I don't know what your overall conclusions are, then I can't tell which errors in a given post are relevant to your conclusions and therefore should be pointed out, and which can be safely ignored. And given how important this topic is, Nesov might think that it's safer to err on the side of too much rather than too little nit-picking. Also it's sometimes unclear which of your posts are meant to be part of your FAI-relevant meta-ethics sequence (as opposed to intended to help LWers improve their human rationality or are just of general interest to LW readers), so Nesov might unnecessarily hold them all to the same high standard intended for FAI-relevant discussion. For example, is your latest post "Are Deontological Moral Judgments Rationalizations?" supposed to be part of that sequence?
0lukeprog
Fair enough. I'll try to make things clearer in some upcoming posts. 'Are Deontological Moral Judgments Rationalizations' is of course relevant to ethics but it's not technically part of my metaethics sequence.
2Vladimir_Nesov
Since you appear to either agree with particular items of my feedback, or alternatively I recognize my own confusion that led to disagreement, how does that make a bad impression of your work, or argue for stopping to write? I think I just don't have anything substantial to say on the topics you write about (as often turns out only in retrospect), so I only react to what I read, and where the reaction is positive, it's usually not useful to express it. As I said recently, I think your contributions are good LW material. You just don't cover the topics I care about, and various reasons conspire to make me misinterpret some of your writings as saying something I believe to be wrong, but every time you point out that they shouldn't be interpreted the way that leads to the disagreement. The disagreement gets dissolved by stipulating more accurate definitions. This makes me suspicious a bit (that the reinterpretations are fake explanations of lack of some of the errors I point out, ways to protect the argument), but I mostly concede, and wait for the connection to normativity you hint at that should make your hidden position (and its relation to preceding material) clearer.
8lukeprog
Thanks. This is helpful, and I believe it to be accurate. I do disagree with this part, though: When I only get negative feedback, and yet my posts are upvoted, I don't know which parts are connecting with people. I only know which parts of my posts are upsetting to people, and which parts are wrong and need to be fixed.
4Vladimir_Nesov
What kind of protocol do you envision? Detailed review is way too much work in most cases, a single perceived flaw is easy to point out, and parts that seem correct usually both cover most of the essay and are expected to be seen as correct by most readers. (More detailed feedback could be gathered using a new software tool, I suspect, like voting on sections of the text, and then summarizing the votes over the text with e.g. its color. It would be more realistic than asking for a different social custom for the same reason normal voting works and asking for feedback about overall impression doesn't.)
9lukeprog
One possible format is: "I like X and Y. More like that, please. But I think B isn't quite right, because Z."
9Vladimir_Nesov
This could actually work... Fighting abundance of choice with sampling. I would modify it this way: * When making a correction or complaint as a top-level comment, choose one positive thing about the post, if any, and point it out first. So this is a more informative form of "IAWYC, but..."
1lukeprog
Exactly!
0Douglas_Knight
I think you are rationalizing. I think you simply want attention and praise and don't care so much about specific feedback. But I disagree with Vladimir: explicit personal attention and praise, while uninformative, are useful; they are better motivators than karma points. I am also skeptical of people's ability to tell you useful things about what they liked in an article. No one is going to tell you that they were convinced by the irrelevant picture of a brain.
2Shmi
You may need to check your priors. Do Mr. Nesov's comments seem negative in general, not just to you? It is worth checking. How does he normally reply to the type of topics you cover? Maybe (apparently) being from the well known land of pessimism affects his style and you interpret a comment as negative when it is not meant to be so? FWIW, I always click on your posts, though I rarely have anything to contribute.
0lukeprog
Yes, though not always. ...at which point I should restate that I have a great deal of respect for Mr. Nesov's intelligence, rationality practice, and contributions to this site.
1mytyde
This is the crux. You can't take a small amount of empirical data, skip sociology, postulate a hypothesis which you don't intend to test, and then generalize from it. I'm not gonna downvote this thread because I don't think stating this hypothesis is bad; I just think its presentation is sloppy. Lukeprog, please don't take this too harshly; I make similar mistakes all the time.
[-]JenniferRM190

One angle here (which you seem to implicitly advocate?) is that including pictures of brains and talking about brain components causes people to change their minds about cognitive/philosophical matters in specific directions. If the results of that exposure are positive then it seems like it might be a good PR strategy, with interesting pedagogical applications if you were trying teach certain lessons from psychology in a vivid and convincing way.

On the other hand it also seems that the effects could be explained by certain kinds of priming mixed with the representativeness heuristic rather than detailed evidence in support of the precise claims that are being made. That is to say: its not clear to me that this phenomena might not be a good way to explain things so much as a "physical brain fallacy" (roughly: just because the brain is physical, doesn't mean a particular claim about cognitive processes is true).

Imagine a control group who get a sales pitch (for a bad product) telling them that they should rationally calculate that it would fulfill their desires and make them happier to buy and use. The experimental group could get roughly the same pitch (for the same ba... (read more)

Reply
8lukeprog
Brain talk acts more like the 'physical brain fallacy' trick. See the last sentence of Weisberg et al.'s abstract: Knowledge of what persuades others can be used for good or evil. I, of course, am hoping that examples of reductionism and so on will be used to persuade people of things that are probably true.
5christina
But if it can be used to explain both true and false hypotheses, it will be used to do both. If you are trying to convince people to be more rational, you should probably first convince them that 'explanations' that don't explain anything are not to be trusted.
0lessdazed
And yet, I don't think that excluding brain talk is pure and neutral, Using non-brain talk undermines one's argument for both true and false hypotheses. The message needs a messenger. And yet! Some things are true, and others false. Using non-brain talk might be the generally less biasing thing, but it isn't a categorically unbiasing thing.
3christina
It was not my intention to emphasize the fact that these explanations mention the brain, but rather their lack of explaining power for the premise to be described/proved. It doesn't matter whether the statement that explains nothing is "neurological differences in brain structure are the underlying causes of schizophrenia" or "it is just common sense that the sky is blue". Neither statement appeals to me because the writer is not using these perfectly good words to explain anything. If I read an explanation, I want it to explain something. If you want to use 7 syllable words, fine. If you want to use only words an average five-year-old knows, that is also fine. If you want every phrase to be achingly brilliant poetry, I have no problem with that. But if the words convey nothing, I will not be amused. What the article above does is convey information about the strategy of using certain words to not convey information (and also to convey information that doesn't necessarily support the main argument, but sounds like it does). I find it useful in the sense that it helps to realize that certain ways of not conveying information can exploit common blind spots in myself and others. I hope this realization helps me to notice these things more often in other's writing, so that I can decrease the credibility I give such statements. And I hope it will help me to notice it more often in my writing, so I can remove such statements.
0lessdazed
If there is a valid explanation involving the brain, the brain is more likely to be cited than if there isn't a valid explanation involving the brain. So the absence of the word "brain" in a given explanation weakly implies that the true explanation does not feature the brain! This implication is regardless of whether or not it is true. So I think the only sentence of yours I disagree with is: I claim we're doomed, and can only choose from among biasing statements distorting along different vectors in the idea space in which the ideas of the person being persuaded are a point, and one's own ideas are a point.
0christina
I am unsure of the intent of the first three sentences you post above. I cannot figure out what relation they have to my post, although perhaps they are not intended as a response to it. I also am unsure what they are intended to illustrate. They seem to all be saying the same thing, and I cannot extract an explanation, description, or argument of any sort from them. If there was a point you wished to make with them that you would like me to understand, you will have to clarify. Would you care to state the reason you think the existence of bias dooms us (I am assuming you mean humanity as a whole, here)? People can learn of the existence of bias. They will always have bias in some direction, but that doesn't mean that they can't learn to reduce their biases and better understand how the world works. Like an asymptote, one can get closer and closer to the truth, even if they cannot reach it. Do you feel the lack of perfection negates progress?
2lessdazed
I have changed my mind, so I won't try and explain it, if that's OK? I now hold to a more moderate but similar view; I will try and explain from scratch. So some words are biasing, and It may happen to be that for some concept, all relevant words are biasing. So "remove all biasing statements from my writing" is a bad heuristic where there are no unbiasing statements, so "remove all biasing statements from my writing when there is a less biasing statement I can use instead" is better.
1christina
Sure, that's up to you. If you prefer to explain only your new viewpoint, that's fine with me. But does your first statement cover the first three sentences of your previous post only, your initial response on bias only, or all of it? As I mentioned, I wasn't clear on the first three sentences at all. Still, feel free to explain or not explain however you wish. I was at first confused by your inclusion(again) of my statement about removing non-informative concepts from my writing. Since I was not talking about removing all biasing statements from my writing, I wasn't sure why you interpreted it as such. Then I realized that lukeprog's article was talking about non-informative statements that also happen to be good at biasing readers in a certain direction. However, removing all non-informative statements of this sort is different from removing all biasing statements, which is how I read your interpretation of it. All biasing statements belong to a different set than the set of all non-informative statements. For example, "Policy A causes the unnecessary deaths of 400 people every year" is a highly biasing statement, but also contains information (which may or may not be true, but that is an entirely different concern). On the other hand, "Neurological reasoning occurs using the left side of the brain" could be used as a biasing non-informative statement in the context of convincing someone about a certain brain function (as discussed in lukeprog's article). Thus, the sets overlap but are not equal. I can see why you would think that removing all biasing statements is impossible. However, I think removing all non-informative statements (especially ones that happen to be strongly biasing) is not impossible, though perhaps difficult depending on the situation. So it seems we essentially agree about non-biasing statements. They can be reduced, but not entirely eliminated. I am not sure what your position is on non-informative statements, however, as I don't think you
0lukeprog
Agreed. I try to teach people about technical explanation, too.
2christina
Incidentally, the link to the spray on clothing video was really cool. I want spray on clothing; then I wouldn't have to go through the tiresome chore of searching for clothes in a store. And they would always fit. And I could make it look however I wanted. I wish I could get some to experiment with now, to see if I could generate some clothing that would be thick enough for my tastes (I think that would be my only concern).
0Normal_Anomaly
That video is cool, but I don't see how it relates to the conversation you're having. Are you saying that the guy's explanation of how the spray-on clothing works is a good one, or a bad one, or is your point something else entirely?
1lukeprog
HAHAHAHA. That was a copy/paste fail. I've updated the link to go where I meant it to go now; the spray-on clothing video has nothing to do with technical explanation. :)
3Normal_Anomaly
Okay, that makes more sense. That's where I thought the link was going before somebody mentioned spray-on clothing in the reply. For people who want to see the spray-clothing video, it's here.
[-]utilitymonster170

A simple explanation is that using phrases like "brain scans indicate" and including brain scan images signals scientific eliteness, and halo effect/ordinary reasoning causes them to increase their estimate of the quality of the reasoning they see.

Reply
[-]christina160

I've decided to upvote your article for presenting a concise summary of this topic and also, very importantly, including links to the full pdfs of the academic articles Weisberg et al. (2008) and McCabe & Castel (2008) which you used to support your argument. This is not always possible, but I think is always to be commended when it is.

However, having now read both of these articles in their entirety, I would like to point out what I believe to be an important omission in your summary of the Weisberg et al. (2008) article.

First, you state:

And yet, Yale cognitive science students rated the 'with neuroscience' explanations as more satisfying than the regular explanations.

You also state:

Somehow I suspect people who chose to study cognition as information processing are less likely than average to believe the mind runs on magic.

You conclude with:

Sometimes even physicalists need to be reminded — with concrete reductionistic details — that they are physicalists.

However, I obtain an entirely different conclusion from this article. First, I shall summarize what I believe to be the salient points of Weisberg et al. (2008):

  • Novices (ie. those who had not chosen to study
... (read more)
Reply
[-]Eliezer Yudkowsky120

But these are Yale cognitive science students. Surely they don't think the mind runs on magic, right?

Wow. I had no idea Yale cognitive science students had reached the astronomical level of competence where we ought to be surprised when they make simple mistakes. I assume that none of them are religious, either?

Reply
5lukeprog
You're right, I said that incorrectly. I should have said that I suspect people are more likely to choose to study cognition as information processing if they think the mind doesn't run on magic. I'll try to fix my wording without being too verbose.
[-]Leon70

I have another possible explanation, which I think deserves a far greater "probability mass'': images make scientific articles seem more plausible for (some of) the same reasons they make advertising or magazine articles seem more plausible -- i.e., precognitive reasons which may have little to do with the articles' content being scientific. McCabe and Castel don't control for this, but it is somewhat supported by their comparison of their study with Weisberg's:

The simple addition of cognitive neuroscience explanations may affect people’s conscious

... (read more)
Reply
[-]orthonormal50

Is it a fair restatement to note that people (physicalists included) get quite different priming effects from 'mind' and 'brain'? The first makes us think of our subjective experience, the second makes us think of a physical object.

I've certainly noticed that reductionist arguments are more convincing to others when I use 'brain' in place of 'mind'.

Reply
4fubarobfusco
Plenty of people who are ostensibly physicalists still seem to alieve that there is something spooky going on in the mind. They seem comfortable with the idea that physical-chemical-biological processes underlie the mind, without being ready to deal with the consequence that these processes constitute the mind.
[-]malthrin40

Here's a piece of supporting evidence for your theory: http://www.economist.com/node/21526321

In particular, the second study. There were four statements of a patient's condition after a traumatic injury: 1) David is healthy and fully recovered. 2) David passed away. 3) David died, was embalmed at the morgue, and is now in the cemetery, in a coffin, underground. 4) David is in a persistent vegetative state.

Group A rated the cognitive function on options 1, 2, and 4. Group B rated the cognitive function on options 1, 3, and 4. Non-religious folks - i.e., mat... (read more)

Reply
2gjm
Your second link gives me an error: "The specified request cannot be executed from current Application Pool". The first link doesn't appear to me to justify the statement that "of course not all libertarianism is 'contra causal'". The Wikipedia article makes reference to a class of libertarian theories that don't involve a non-physical mind overriding causality, but the only example of such a theory it says anything about is Kane's, and it's far from clear to me that Kane's notion of free will is really libertarian (for the reason given in the article and ascribed there to Randolph Clarke). If you define "libertarianism" as meaning only that free will and strict determinism are incompatible, then I agree and probably Luke does too: "of course" libertarianism needn't be contra-causal. (Well ... I suppose it depends on exactly how you define "contra-causal". I'd have thought that with that definition of "libertarianism", it would be natural to define "contra-causal" as "not deterministic", and then libertarian free will --> contra-causal free will after all.) But someone who believes, e.g., that free will = determinism + chance is "libertarian" in that sense, and that's surely neither what Luke had in mind nor what most other people have in mind when they talk about (metaphysical) libertarianism. (I don't much like the term "contra-causal", though. After all, libertarians commonly don't say that free choices are uncaused but that they (and not, e.g., any merely physical process) caused those choices. "Contra-physical" would get nearer to the heart of the matter.)
0Peterdjones
Now amended. It's far from clear to me that the objection sticks for the reasons also given in the article. But just about everything is disputable in philosophy. So there is no clear cut fact that libertarianism is "contra causal". Neither do I.
[-]christina20

On the subject of acausal free will, I wonder if it is simply a misinterpretation of the benefits that we can gain through our choices. While we don't have free will in the sense of our choices being uncaused, we do have more choices available to us, than say, a cow or a spider. So we have the freedom to choose better, even if not the freedom to choose whatever. So here I am hypothesizing that people interpret greater intelligence as greater acausal free will.

Reply
[-]lukeprog10

Cognitive scientists share a number of basic assumptions... the most fundamental driving assumption of cognitive science is that minds are information processors... Almost all cognitive scientists are convinced that in some fundamental sense the mind just is the brain.... Few, if any, cognitive scientists are dualists, who think that the mind and the brain are two separate and distinct things.

Bermudez, Cognitive Science, page 6.

Reply
[-]Raemon10

Thank you for the button-pressing report. I've been looking for something like that for a while. (Well, by "looking" I probably mean "sort of wishing I'd accidentally stumble upon it.")

Reply
[-]PhilGoetz00

Nice, modulo Christina's comment below. But, I wouldn't place any stock in time-delay button-pressing experiments. They are only suprising if you both a) believe in free will, AND b) believe that the freely-willed action, and the conscious experience of making that decision, must be simultaneous.

There is no reason to expect this, and many reasons to expect it not to be the case, even if you believe in free will. I don't know if it's even meaningful to ask "when" a perception occurred - your brain may present you with a percept, and backdate it or forward-date it.

Reply
[-]Mitchell_Porter00

It's just that physicalists take the controlled and repeated findings of physics and neuroscience as being stronger evidence than their own subjective experience is.

This is not a straightforward matter. There are people who deny the existence of colors, of time, of any sort of will, or any sort of subjective experience, on the basis of "physicalism" or "science". Physics and neuroscience actually contain no such thing as "subjective experience". Do you therefore conclude that there is no such thing at all? No, you believe ... (read more)

Reply
6lessdazed
Do they deny the existence of rainbows?
2Richard_Kennaway
I think you understate the problem. The relationship is totally obscure. On the one hand, there is the "it's all made of atoms" tradition that got started two centuries ago, which, together with the Baconian idea that you have to look at nature to discover anything about it, has proved enormously successful everywhere it has been applied, and continues to be so. And on the other hand, there is subjective experience, the problem with which is that no-one has any idea at all of how such a thing could possibly exist in a world made of atoms. Not only do we not know how it arises, we cannot see any way it could possibly arise from atoms. The two things appear absolutely, utterly incompatible. But hardly anyone looks squarely at that conflict and acknowledges it. Instead, they confabulate to fill the gap. Some invent ontologically fundamental mental entities, which amounts to no more than plastering labels like "soul" or "the divine" over their ignorance. Some deny the existence of subjective experience. Some give explanations only of how we come to talk about subjective experience, but leave the thing itself untouched -- p-zombie theories. Some come up with explanations that amount to finding a correlation with some observable physical phenomenon and identify it with that -- as if, in cruder terms, one were to explain the mind by saying it's the brain, or to take such fake explanation to the point of absurdity, one were to explain the mind by saying it's made of atoms. This is more than just not knowing how it works: nobody knows how it could possibly work.
1lessdazed
If one of the "confabulations" were true, how would you know? Likewise for if no one knew how it worked, but thought they knew how it could possibly work; how would you know if they were right aside from having a full explanation?
2Richard_Kennaway
Which one? Ontologically fundamental mental entities? Show me one that isn't an empty label. The other three -- denying the existence of subjective experience, p-zombie explanations, and interpreting correlation with a physical phenomenon as identity all miss the mark. They are not things that even could be explanations. That's probably not an exhaustive list -- it can't be, if there really is an explanation -- but vague hypotheticals don't help. Show me a purported explanation of the existence of subjective experience that isn't an example of one of these four fallacies and then there will be something to talk about. Well, how would you know if someone was right about the mechanism of high-temperature superconductivity? You would look at whatever they did -- theoretical modelling, experiments, whatever -- and judge whether the reasoning and the experimental setup were sound. You would compare it with other work in the field. You might do theoretical and experimental investigations of your own. This is intended to be a simple answer to a simple question. The same sort of processes are how you would judge any explanation of the existence of subjective experience. Here, for example, is an imaginary explanation of consciousness: control systems are conscious! Firstly, even accepting that all living organisms are chock full of control systems, this is an example of fallacy no.4: finding a physical phenomenon apparently causally linked with consciousness and saying the two are the same. But leaving that aside, one can very easily find control systems in the human brain that are inaccessible to consciousness: motor control. When you move an arm you are not aware of the individual muscles you are operating. Even when you learn a complex motor skill like juggling, the processes by which the cerebellum learns the task are completely inaccessible to you. So there's a large and complex collection of control systems sitting right next to and intimately connected with what ap
4lessdazed
I don't understand what single thing, if any, disqualifies them. Tell me if I'm wrong, but I think you would agree they have unique issues, just as "being an empty label" is something that won't be wrong with, say, denying subjective experience. You made a good point about the inexhaustibility of wrong explanations, which I suppose is true for everything. So I certainly don't ask for anything like a complete list of bad explanations and their problems! But of the other three you mentioned, do they share a problem, or what are their unique problems, or is it too complicated to explain in a comment? Can you explain why the other three are hopeless as well as you did for the first? This is a thing it might be hard to do well. Were I called upon to support my claim that "'being an empty label" is something that won't be wrong with, say, denying subjective experience, I might not last long against an honest skeptic before resorting to profanity and threats of violence if they disagreed. "Because they say there is nothing so they are not saying that there is something where the "something" is literally no more than the thing. Because there is no thing. %@*!" But please try. I'm trying to get at the difference between knowing about something that no one has a perfect model and knowing that no one has the correct framework to think about building a working model. From "This is more than just not knowing how it works: nobody knows how it could possibly work," building a working model shows one knows how something works, and absence of one is evidence someone does not know how something works. But how does one distinguish the various ways to not have a perfect model? What evidence is there about whether people are working on something correctly, aside from a complete and finished explanation? To put it another way, what stops one from being able to point at an unsolved problem, say one universally admitted to be unsolved, and declaring no one has any idea how to think ab
[-]Richard_Kennaway120

I don't understand what single thing, if any, disqualifies them. Tell me if I'm wrong, but I think you would agree they have unique issues, just as "being an empty label" is something that won't be wrong with, say, denying subjective experience.

You made a good point about the inexhaustibility of wrong explanations, which I suppose is true for everything. So I certainly don't ask for anything like a complete list of bad explanations and their problems! But of the other three you mentioned, do they share a problem, or what are their unique problems, or is it too complicated to explain in a comment? Can you explain why the other three are hopeless as well as you did for the first?

I feel a bit like I'm Eliezer expaining the instant failure modes of most AGI research (but not as smart), and that there could be a whole sequence of postings on the instant failure modes of explanations of consciousness.

Well, I don't think I can write those postings, or at least, devote the many days it would take me. Just some brief notes here amplifying the fallacies with examples.

What evidence is there about whether people are working on something correctly, aside from a complete and finis

... (read more)
Reply
3BobTheBob
The comments of yours I've read are always clear and insightful, and usually I agree with what you say. I have to disagree with you here, though, about your supposed second fallacy. I disagree. Arguments against qualia typically challenge the very coherence of anything which could play the desired role. It's not like trying to prove fire doesn't exist, it's like trying to prove there is no such thing as elan vital or chakras. I deny the existence of UFOs. It's pretty clear what UFOs are - spaceships built and flown to Earth by creatures who evolved on distant planets - and I can give fairly straight-forward probabilistic reasons of the kind amenable to rational disagreement, for my stance. I (mostly) deny the existence of God. Apologies if you're a theist for the bluntness, but I don't think it's at all clear what God is or could be. Every explication I've ever encountered of God either involves properties which permit the deduction of contradictions (immovable rocks/unstoppable forces and what-not), or are so anodyne or diffuse as to be trivial ('God is love' -hence the 'mostly'). There is enough talk in our culture about God, however, to give meaning to denials of His existence - roughly, 'All (rather, most of) this talk which takes place in houses of worship and political chambers involving the word 'God' and its ilk, involves a mistaken ontological commitment'. Do I deny the existence of consciousness, or subjective experience? If my wife and I go to a hockey game or a play, we in some sense experience the same thing -there is a common 'objective' experience. But equally we surely have in some sense different experiences - she may be interested or bored by different parts than I am, and will see slightly different parts of the action than I. So clearly there is such a thing as subjective experience, in some sense. This, however, is not what is at issue. Roughly, what we are concerned about is a supposed ineffable aspect of experience, a 'what it is like'. I
0Richard_Kennaway
I think there's some hindsight bias there, in the case of chakras. It is by no means obvious that these supposed centres of something-or-other distributed along the spine and in the head don't exist. One might be sceptical purely on account of the sources of the concept being mystical or religious, but the same is true of meditation, which has been favourably spoken of by rationalists. It's only by actually looking for structures in the places where the chakras are supposed to be and not finding anything that could correspond to them that the idea can be discarded. There is also (I think) the fact that different traditions assert different sets of chakras. "Élan vital" was always a fake explanation for a phenomenon -- life -- that no-one understood. It's like a doctor listening to a patient's symptoms and solemnly making a diagnosis by repeating the symptoms back to the patient in medical Latin. No-one talks about élan vital now because the subject matter succumbed to investigation based on "stuff is made of atoms". But consciousness is different -- we experience it. We have no explanation for it, just the experience -- the fact that there is such a thing as experience. "Consciousness", "sensation", "experience", "qualia", and so on are not explanations, just names for the phenomenon. To me, this is exactly what is at issue. We have subjective experience, yet we have no idea how there can possibly be such a thing. All discussions of this, it seems to me, immediately veer off into people on one side putting up explanations of what it is, and people on the other knocking them down. The fact of experience remains, ignored by the warring parties. There is no case to be made. Either you have this experience or you do not. I have it and I think that most people do. What people -- at least, those who do have subjective experience -- need to do first is recognise that there is a problem: I have subjective experience. It is impossible for there to be any such thing as
3soreff
I find this class of explanations plausible, myself. I find it at least imaginable that my "feeling" of consciousness basically is the stream of potential reports about myself that I could voice, if there were an interested listener to voice them to. To put it another way: Are you quite sure that the way we feel about ourselves isn't the same as the way we talk about ourselves (except for the inhibition of actual vocalization)? How would one show that the stream of potentially vocalized self-reports isn't consciousness? What would distinguish them?
3Richard_Kennaway
I look around, and have visual experiences. These, it seems to me, are obviously different from any words I might say, or think but not say, about those experiences.
1soreff
Good point! I might sketch a visual experience, but I don't ordinarily consider my visual experience to be a sequence of sketches, analogous to an ongoing interior monologue...
1lukeprog
No, it's not straightforward. I didn't want to get into all that, so I've removed that sentence from my post now.
Moderation Log
76Comments