gwern comments on Is Sunk Cost Fallacy a Fallacy? - Less Wrong

19 Post author: gwern 04 February 2012 04:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

You are viewing a single comment's thread. Show more comments above.

Comment author: Jiro 01 November 2014 06:14:40PM 0 points [-]

That's like asking "If homeopathy worked and all the doctors were wrong, would they admit it?" You can't just flip a bit in the world setting Homeopathy_Works to TRUE and keep everything else the same. If homeopathy worked and yet doctors still didn't accept it, that would imply that doctors are very different than they are now, and that difference would manifest itself in lots of other ways than just doctors' opinion on homeopathy.

If funding the Apollo Project was a complete waste of money compared to the normal grant process, the world would be a different place, because that would require levels of incompetency on NASA's part so great that it would get noticed.

Or for another example: if psi was real, would James Randi believe it?

Comment author: ChristianKl 01 November 2014 07:12:42PM -1 points [-]

That's like asking "If homeopathy worked and all the doctors were wrong, would they admit it?" You can't just flip a bit in the world setting Homeopathy_Works to TRUE and keep everything else the same.

You can look at cases like chiropractors. Over a long time there was a general belief that chiropractors didn't provide any good for patients because they theory based on which chiropractors practice is in substantial conflict with the theories used by Western medicine.

Suddenly in 2008 Cochrane comes out with the claim that chiropractors actually do provide comparable health benefits for patients with back pain as conventional treatment for backpain.

A lot of the opposition to homeopathy is based on the fact that the theory base of homeopathy is in conflict with standard Western knowledge about how things are supposed to work.

People often fail to notice things for bad reasons.

Comment author: Jiro 02 November 2014 04:29:47AM *  2 points [-]

There are very good reasons why finding that one set of studies shows an unusual result is not taken as proof by either doctors or scientists. (It is also routine for pseudoscientists to latch onto that one or few studies when they happen.)

In other words, chiropractic is not such a case.

[the] theory based on which chiropractors practice is in substantial conflict with the theories used by Western medicine.

I hope you're not suggesting that the theories used by Western medicine are likely to be wrong here.

Comment author: ChristianKl 02 November 2014 12:14:40PM -1 points [-]

There are very good reasons why finding that one set of studies shows an unusual result is not taken as proof by either doctors or scientists.

Cochrane meta studies are the gold standard. In general they do get taken as proof.

The main point is that you don't need to have a valid theory to be able to produce empirical results.

Then I'm also don't believe that issues surrounding back pain are very well understood by today's Western medicine.

Comment author: Jiro 02 November 2014 12:46:34PM 2 points [-]

Cochrane meta studies are the gold standard. In general they do get taken as proof.

As a matter of simple Bayseianism, P(result is correct|result is unusual) depends on the frequency at which conventional wisdom is wrong, compared to the frequency at which other things (errors and statistical anomalies) exist that produce unusual results. The probability that the result of a study (or meta-study) is correct given that it produces an unusual result is not equivalent to the overall probability that studies from that source are correct, so "Cochrane meta studies are the gold standard" is not the controlling factor. (Imagine that 0.2% of their studies are erroneous, but conventional wisdom is wrong only 0.1% of the time. Then the probability that a study is right given that it produces a result contrary to conventional wisdom is only 1/3, even though the probability that studies in general are right is 99.8%.)

That's why we have maxims like "extraordinary claims require extraordinary evidence".

Comment author: hyporational 08 November 2014 06:20:17AM *  0 points [-]

FYI it isn't even clear the review he mentions says what he thinks it says, not to mention the reviewers noted most of the studies had high risk of bias. "Other therapies" as controls in the studies doesn't necessarily mean therapies that are considered to be effective.

Comment author: ChristianKl 02 November 2014 01:50:44PM 0 points [-]

The evidence for chiropractic intervention for lower back pain is good enough that RationalWiki which is full of people who don't like chiropractics write: "There is evidence that chiropractic can help alleviate symptoms of low back pain." RationalWiki then adds that the cost and risks still suggest to that it's good to stay aware from chiropractors.

Conventional wisdom by people who care about evidence for medical treatment is these days is that chiropractical interventions have effects for alleviate symptoms of low back pain.

That makes it a good test to identify people who pretend to care about evidence-based medicine but who care about medicine being motivated by orthodox theory instead of empirical evidence.

Comment author: Jiro 02 November 2014 04:51:51PM *  0 points [-]

people who don't like chiropractics write: "There is evidence

Of course they'll write that. After all, there is evidence. You were implying that there's good evidence.

RationalWiki then adds that the cost and risks still suggest to that it's good to stay aware from chiropractors.

In other words, the evidence isn't all that good.

Conventional wisdom by people who care about evidence for medical treatment is these days is that chiropractical interventions have effects for alleviate symptoms of low back pain.

This is a no true Scotsman fallacy. You're asserting that anyone who seems to be part of conventional wisdom but doesn't agree doesn't count because he doesn't care about evidence.

Comment author: ChristianKl 02 November 2014 05:50:25PM 0 points [-]

In other words, the evidence isn't all that good.

No. Saying that costs and side effects aren't worth something is very different than saying it doesn't work and produces no effect.

Conventional treatment is often cheaper than chiropractics. Dismissing it on those grounds is very different than dismissing it on grounds that it produces no effect. Given that they don't like it they need to make some argument against it ;) Not being able to argue that it doesn't work make them go for risks and cost effectiveness.

This is a no true Scotsman fallacy. You're asserting that anyone who seems to be part of conventional wisdom but doesn't agree doesn't count because he doesn't care about evidence.

Cochrane meta studies have a reputation that's good enough that even venues like RationalWiki accept it when it comes to conclusions that they don't like.

There no meta study that's published after the Cochrane results that argues that the Cochrane analysis get's things wrong. Conventional of evidence-based medicine than suggests to use the Cochrane results as best source of evidence. It not only RationalWiki. Any good evidence-based source that has a writeup about chiropractics will these days tell you that the evidence suggests that it works for back pain for a value of works that means it works as well as other conventional treatments for back pain.

Comment author: Jiro 03 November 2014 12:25:40AM 0 points [-]

Saying that costs and side effects aren't worth something is very different than saying it doesn't work and produces no effect.

No, they're not very different at all. In fact they are directly related. Saying that costs and side effects are too great means that costs and side effects are too great for the benefit you get. If there is some probability that the study is bad and there is no benefit, that gets factored into this comparison; the greater the probability that the study is bad, the more the costs and side effects tip the balance against getting the treatment.

Cochrane meta studies have a reputation that's good enough that even venues like RationalWiki accept it when it comes to conclusions that they don't like.

You didn't say that everyone accepts it. You said that everyone who cares about evidence accepts it. This is equivalent to "the people who don't accept it don't count because their opinions are not really based on evidence". Likewise, now you're claiming "any good evidence-based source" will say that it works. Again, this is a No True Scotsman fallacy; you're saying that anyone who disagrees can't really be an evidence-based source.

Comment author: Strange7 03 November 2014 01:30:49PM 1 point [-]

It's only a No True Scotsman if you can point to an actual citizen of Scotland who doesn't meet the 'true Scotsman' standard.

You are conflating two claims here. One is that chiropractic is more expensive than conventional treatments for lower back pain, and the other is that chiropractic is less effective than conventional treatments for lower back pain. What support do you have for the latter claim?