John Wilkes Booth: You know you really ought to do something about that stomach.
Zangara: I do everything about the stomach!
Booth: Oh yes?
Zangara: I give up wine. No good! I give up smokes. No good! I quit my work. No good! I move Miami. No good! I TAKE APPENDIX OUT! No good! Nothing no good! Nothing! Nothing! Nothing!
Booth: Have you considered shooting Franklin Roosevelt?
Zangara: You think that help?
Booth: It couldn't hurt...
-- Assassins shows up how privileging hypotheses is done.
"Is it cold out in space, Bowie?"
"You can borrow my jumper if you like, Bowie!"
"Does the cold of deep space make your nipples get pointy, Bowie?"
"Do you use your pointy nipples as telescopic antennae to transmit data back to earth?"
"I bet you do, you freaky old bastard you!"
[...]
"Receiving transmission...from David Bowie's nipple antennae!"
--Flight of the Conchords helps
Just to confirm:
Another way of explaining the 'locating the hypothesis' concept would be to say: "When answering a question with a large number of possible answers, it takes more work to narrow down the possibilities (generate the reasonable hypotheses) than it does to test those hypotheses for correctness."
Is that right?
I agree that privileging a hypothesis is a common error. I don't agree that it applies in the example used, though.
If you have a tradition thousands of years old saying that a particular spot was the site of Nazareth in 4BC, or of Troy in 1200BC, it isn't irrational to privilege the hypothesis that that spot was indeed the site of Nazareth, or of Troy.
Similarly, when the entire world has used the single-world hypothesis almost exclusively until the recent past, it isn't unfairly privileging it to still consider it a major contender.
You might think this is more like evolution vs. creationism. I don't mean that we should keep teaching creationism in school as an alternative today. But we haven't got as strong an argument for many-worlds as we do for evolution.
Also, AFAIK there's just these 2 competing hypotheses: One-world, many-world. We don't have the 7-worlds hypothesis and the 23-worlds hypothesis and the pi-worlds hypothesis. We could have the countable-worlds hypothesis and the uncountable-worlds hypothesis, but AFAIK we don't even have those. How can you say it's irrational to consider 1 of the only 2 hypotheses available?
Also, AFAIK there's just these 2 competing hypotheses: One-world, many-world.
Reminiscent of the guy who was asked what were the odds he would win the lottery, and replied, "Fifty-fifty, either I win or I don't." The corresponding heuristic-and-bias is I think known as "packing and unpacking" or something along those lines.
I remember the Daily Show had a funny example of this in action. They were interviewing people about the possibility of the Large Hadron Collider destroying the earth, and they talked to a physicist and a crazy survivalist. The former said it was impossible for the LHC to destroy the earth, while the latter used basically that argument: "There are two possibilities: it can destroy us, or not. So, that's about a 50/50 chance."
Then later the interviewer followed the survivalist to his bunker and asked him: if everyone died but them, don't they have an obligation to mate to repopulate the earth? (They were both men.) The survivalist said, "Um, no, because that doesn't work. It's impossible." And then the interviewer came back with, "well, there's two possibilities: we'll produce a baby, or we won't, so that's 50/50 -- pretty good odds."
I'm sure someone would love to dig up the clip...
Once you accept that there exists something isomorphic to a wave function, it's more like:
many worlds vs. many worlds and an orang-utan vs. many worlds and an apple tree vs. many worlds and a television vs. many worlds and a blue castle vs. (...) vs. many worlds and a character-of-natural-law-violating process that constantly kills all the worlds except one.
All cases except the last case contain many worlds, but Phil packed them together. I think that's the intuition Eliezer was getting at.
We shouldn't be afraid here to sound Orwellian. Copenhagen people believe in the many worldeaters interpretation. We believe in the no worldeaters interpretation.
"Should array indices start at 0 or 1? My compromise of 0.5 was rejected without, I thought, proper consideration."
--Stan Kelly-Bootle
I don't know, this "Mortimer Q. Snodgrass" fellow seems pretty suspicious to me. I mean, a weird name like that is probably an alias. And "Ordinary Lane"? At a power of 2 no less? Tell me he plays tennis and I'll be convinced he did it.
And even if he wasn't the murderer, he's probably guilty of something. Check his computer for pirated music! ;)
You are asserting a false duality. Either many-worlds, OR a collapse postulate. You use evidence AGAINST a collapse as evidence FOR many worlds, which is very weak evidence. Here is a third alternative- the wavefunction is not real- merely a mathematical formalism used to calculate probability distributions (this map doesn't have to be the territory). Here is a fourth- collapse is an approximation to a small, non-linear self-coupling in the equation that governs time evolution. Here is a fifth- evolution is governed by both the advanced and retarded G...
I think that "privileging the hypothesis" is an example of special pleading (http://en.wikipedia.org/wiki/Special_pleading) being applied to the selection of a hypothesis, as opposed to the evaluation of the hypothesis.
And the corresponding anti-epistemology is to talk endlessly of "possibility" and how you "can't disprove" an idea
Something to point out to someone who says this is that 'possibility' is not a constraint - EVERYTHING is possible. As far as I know (and correct me if i'm wrong cause that would be a major fuckup), you can't assign a probability of zero to anything. You can't seperate the possible things from the impossible ones, and then focus only on the possible. 'Possible', by itself, applies to everything, so you don't say anything by declaring something 'possible'. It's only when you start talking about degrees of possibility that the word has any meaning.
I tend to think that the Bible and the Koran are sufficient evidence to draw our attention to the Jehovah and Allah hypotheses, respectively. Each is a substantial work of literature, claiming to have been inspired by direct communication from a higher power, and each has millions of adherents claiming that its teachings have made them better people. That isn't absolute proof, of course, but it sounds to me like enough to privilege the hypotheses.
Eliezer, speaking of "privileging the hypothesis," what do you think about the proscription in statistics against "data dredging," or using past data to support post hoc hypotheses suggested by the data? What do you think about the view of descriptive science being inferior to hypothesis-driven science?
Based on your analysis, it would indeed seem that a hypothesis that could be located prior to an experiment might be more probable than a hypothesis that could only be located after an experiment.
Yet is there an over-emphasis placed on th...
I think this is a great follow up to: http://lesswrong.com/lw/o3/superexponential_conceptspace_and_simple_words/ (scroll to the very end of that post)
"But because of a historical accident, collapse postulates and single-world quantum mechanics are indeed on everyone's lips and in everyone's mind to be thought of"
I think there's more to it than historical accident. After all, it was a historical accident, of sorts, that people believed one could sail directly west from Europe to arrive in Asia, but once a continent was found in between it was no trouble at all to overturn that belief. Historical accident is not the only reason, or necessarily the major reason, that we are still struggling with ...
grand total of zero
I have perceived exactly one world all my life. Isn't that evidence that exactly one world exists?
It may be that privileging the hypothesis -- or, more specifically, unjustifiably promoting a hypothesis about the goodness of a particular product or service to people's attention -- is the business end of TV advertising.
In general I agree, and of course Copenhagen is nonsense, but I think you privilege the hypothesis of Many-Worlds over Bohm. You see, Bohm has an explanation for the Born probabilities---they are a stable equilibrium state called, appropriately, "quantum equilibrium". So there are not even any open questions.
And yes, Bohm is non-local, which you could say is a problem... or you could say it explains why quantum mechanics is different from classical mechanics. (Obviously no quantum theory is going to satisfy all our classical intuitions, or it wo...
Eliezer: privileging the hypothesis is known as the Prosecutor's fallacy. I like your name better though.
I see how this applies to different deities of the same complexity. What about the Maimonidean-type "negative theology" - http://en.wikipedia.org/wiki/Negative_theology#In_the_Jewish_tradition ? Basically this implies a perfectly simple diety "of reference class size 1". It seems harder to say that the hypothesis is arbitrary in this case.
Im just reading Thomas Schelling's Theory of Conflict and one of his key tenets is that providing an identifiable point around which the discussion can be centered will tend to lead the discussion to be centered around that (classical anchoring). However, he brings out that in many cases, having a "line in the sand" brings benefits to all sides by allowing intermediate deals to be struck when only extremes were possible before.
This article, however, clearly demonstrates that having a line in the sand can be just as bad as it can be good, as it is with all of biases. However, I really recommend Schelling hit on "what is good" (in the evolutionary sense) about this phenomenon.
The following formula is difficult to read at a first glance because of the unfortunate line break: (water -> ice cubes + electricity)
I was first trying to parse it as: water "minus" "is greater than" ice cubes...
The wikipedia article for Abductive Reasoning claims this sort of privileging the hypothesis can be seen as an instance of affirming the consequent.
Good post.
I'm not sure that 'privileging the hypothesis' deserves to be called a fallacy, though. It's only a bad idea because of the biases that humans happen to have. It can lead to misconceptions for us primates, but it's not a logical error in itself, is it?
Posthoc hypothesising is only a problem when you're using that hypothesis to analyse the same data that inspired it. Machine learning experts avoid this mistake by backtesting and foreward testing out of sample data.
Analysing unstructured data is useful for generating hypotheses, rather than for testing them to develop a model. Take computational epidemiology:
In contrast with traditional epidemiology, computational epidemiology looks for patterns in unstructured sources of data, such as social media. It can be thought of as the hypothesis-generating antecedent to hypothesis-testing methods such as national surveys and randomized controlled trials.
What do you think of Huw Price's suggestion (http://www.powells.com/biblio/72-9780195117981-0) that if one allows for the possibility of advanced action, it's possible to have paradox-free physics within a single universe, since Bell's theorem only proved the non-existence of non-local hidden variables?
Surely being a supervillain (possibly formerly) is worth a lot of evidence against Mortimer, though.
This isn't a fallacy; this is just trusting the information you're given. You've gamed the system to break expectations.
Someone tells me, "Don't touch the stove when it's red; it will burn your hand." That's the hypothesis. I'm assuming it's built on some experience and knowledge. Of course I'm going to privilege this particular hypothesis instead of the many others, like "When the stove is red, you will win the lottery," or "When the stove is red, you can't die." I'm trying to get up to speed on an ongoing situation, and so ...
Speaking of privileging the hypothesis...
http://www.theonion.com/content/video/crime_reporter_finds_way_of
This is essentially an instance of availability bias. Of course, the most interesting case, rather than just a declarative hypothesis elevated among the other inhabitants of the hypothesis space for that particular question, models have other effects that go far beyond merely availability.
This is because our initial model won't just form the first thing we think of when we examine the question, but some of the very structures we use when we formulate the question. Indeed, how we handle our models is easily responsible for the majority of the biases that h...
Suppose that the police of Largeville, a town with a million inhabitants, are investigating a murder in which there are few or no clues—the victim was stabbed to death in an alley, and there are no fingerprints and no witnesses.
Then, one of the detectives says, “Well… we have no idea who did it… no particular evidence singling out any of the million people in this city… but let’s consider the hypothesis that this murder was committed by Mortimer Q. Snodgrass, who lives at 128 Ordinary Ln. It could have been him, after all.”
I’ll label this the fallacy of privileging the hypothesis. (Do let me know if it already has an official name—I can’t recall seeing it described.)
Now the detective may perhaps have some form of rational evidence that is not legal evidence admissible in court—hearsay from an informant, for example. But if the detective does not have some justification already in hand for promoting Mortimer to the police’s special attention—if the name is pulled entirely out of a hat—then Mortimer’s rights are being violated.
And this is true even if the detective is not claiming that Mortimer “did” do it, but only asking the police to spend time pondering that Mortimer might have done it—unjustifiably promoting that particular hypothesis to attention. It’s human nature to look for confirmation rather than disconfirmation. Suppose that three detectives each suggest their hated enemies, as names to be considered; and Mortimer is brown-haired, Frederick is black-haired, and Helen is blonde. Then a witness is found who says that the person leaving the scene was brown-haired. “Aha!” say the police. “We previously had no evidence to distinguish among the possibilities, but now we know that Mortimer did it!”
This is related to the principle I’ve started calling “locating the hypothesis,” which is that if you have a billion boxes only one of which contains a diamond (the truth), and your detectors only provide 1 bit of evidence apiece, then it takes much more evidence to promote the truth to your particular attention—to narrow it down to ten good possibilities, each deserving of our individual attention—than it does to figure out which of those ten possibilities is true. It takes 27 bits to narrow it down to ten, and just another 4 bits will give us better than even odds of having the right answer.
Thus the detective, in calling Mortimer to the particular attention of the police, for no reason out of a million other people, is skipping over most of the evidence that needs to be supplied against Mortimer.
And the detective ought to have this evidence in their possession, at the first moment when they bring Mortimer to the police’s attention at all. It may be mere rational evidence rather than legal evidence, but if there’s no evidence then the detective is harassing and persecuting poor Mortimer.
During my recent diavlog with Scott Aaronson on quantum mechanics, I did manage to corner Scott to the extent of getting Scott to admit that there was no concrete evidence whatsoever that favors a collapse postulate or single-world quantum mechanics. But, said Scott, we might encounter future evidence in favor of single-world quantum mechanics, and many-worlds still has the open question of the Born probabilities.
This is indeed what I would call the fallacy of privileging the hypothesis. There must be a trillion better ways to answer the Born question without adding a collapse postulate that would be the only non-linear, non-unitary, discontinous, non-differentiable, non-CPT-symmetric, non-local in the configuration space, Liouville’s-Theorem-violating, privileged-space-of-simultaneity-possessing, faster-than-light-influencing, acausal, informally specified law in all of physics. Something that unphysical is not worth saying out loud or even thinking about as a possibilitywithout a rather large weight of evidence—far more than the current grand total of zero.
But because of a historical accident, collapse postulates and single-world quantum mechanics are indeed on everyone’s lips and in everyone’s mind to be thought of, and so the open question of the Born probabilities is offered up (by Scott Aaronson no less!) as evidence that many-worlds can’t yet offer a complete picture of the world. Which is taken to mean that single-world quantum mechanics is still in the running somehow.
In the minds of human beings, if you can get them to think about this particular hypothesis rather than the trillion other possibilities that are no more complicated or unlikely, you really have done a huge chunk of the work of persuasion. Anything thought about is treated as “in the running,” and if other runners seem to fall behind in the race a little, it’s assumed that this runner is edging forward or even entering the lead.
And yes, this is just the same fallacy committed, on a much more blatant scale, by the theist who points out that modern science does not offer an absolutely complete explanation of the entire universe, and takes this as evidence for the existence of Jehovah. Rather than Allah, the Flying Spaghetti Monster, or a trillion other gods no less complicated—never mind the space of naturalistic explanations!
To talk about “intelligent design” whenever you point to a purported flaw or open problem in evolutionary theory is, again, privileging the hypothesis—you must have evidence already in hand that points to intelligent design specifically in order to justify raising that particular idea to our attention, rather than a thousand others.
So that’s the sane rule. And the corresponding anti-epistemology is to talk endlessly of “possibility” and how you “can’t disprove” an idea, to hope that future evidence may confirm it without presenting past evidence already in hand, to dwell and dwell on possibilities without evaluating possibly unfavorable evidence, to draw glowing word-pictures of confirming observations that could happen but haven’t happened yet, or to try and show that piece after piece of negative evidence is “not conclusive.”
Just as Occam’s Razor says that more complicated propositions require more evidence to believe, more complicated propositions also ought to require more work to raise to attention. Just as the principle of burdensome details requires that each part of a belief be separately justified, it requires that each part be separately raised to attention.
As discussed in Perpetual Motion Beliefs, faith and type 2 perpetual motion machines (water → ice cubes + electricity) have in common that they purport to manufacture improbability from nowhere, whether the improbability of water forming ice cubes or the improbability of arriving at correct beliefs without observation. Sometimes most of the anti-work involved in manufacturing this improbability is getting us to pay attention to an unwarranted belief—thinking on it, dwelling on it. In large answer spaces, attention without evidence is more than halfway to belief without evidence.
Someone who spends all day thinking about whether the Trinity does or does not exist, rather than Allah or Thor or the Flying Spaghetti Monster, is more than halfway to Christianity. If leaving, they’re less than half departed; if arriving, they’re more than halfway there.
An oft-encountered mode of privilege is to try to make uncertainty within a space, slop outside of that space onto the privileged hypothesis. For example, a creationist seizes on some (allegedly) debated aspect of contemporary theory, argues that scientists are uncertain about evolution, and then says, “We don’t really know which theory is right, so maybe intelligent design is right.” But the uncertainty is uncertainty within the realm of naturalistic theories of evolution—we have no reason to believe that we’ll need to leave that realm to deal with our uncertainty, still less that we would jump out of the realm of standard science and land on Jehovah in particular. That is privileging the hypothesis—taking doubt within a normal space, and trying to slop doubt out of the normal space, onto a privileged (and usually discredited) extremely abnormal target.
Similarly, our uncertainty about where the Born statistics come from should be uncertainty within the space of quantum theories that are continuous, linear, unitary, slower-than-light, local, causal, naturalistic, et cetera—the usual character of physical law. Some of that uncertainty might slop outside the standard space onto theories that violate one of these standard characteristics. It’s indeed possible that we might have to think outside the box. But single-world theories violate all these characteristics, and there is no reason to privilege that hypothesis.