You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Viliam comments on Open Thread March 7 - March 13, 2016 - Less Wrong Discussion

4 Post author: Elo 07 March 2016 03:24AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (125)

You are viewing a single comment's thread. Show more comments above.

Comment author: Viliam 11 March 2016 09:07:37AM 5 points [-]

I agree that we should pay more attention to biases, including gender biases.

Unfortunately, it seems to me that people who talk loudest about these topics are even worse than average; that their strategy is more or less "reversed stupidity plus strong political mindkilling". They usually don't care about scientific method at all, because they see this whole process as a fight between the good side and the evil side, and the scientific method itself is a part of the evil side. (They seem unable to understand the difference between "a white cis het man said '2+2=4'" and "'2+2=4' is an evil white cis het fact".)

Comment author: Lumifer 11 March 2016 04:02:46PM 1 point [-]

They usually don't care about scientific method at all, because they see this whole process as a fight between the good side and the evil side

The scientific method is a tool of fascist oppression!

You think I'm joking? Let me quote you from a presumably peer-reviewed International Journal of Evidence-Based Healthcare:

the objective of this paper is to demonstrate that the evidence-based movement in the health sciences is outrageously exclusionary and dangerously normative with regards to scientific knowledge. As such, we assert that the evidence-based movement in health sciences constitutes a good example of microfascism at play in the contemporary scientific arena.

(source)

Comment author: philh 11 March 2016 06:01:50PM 0 points [-]

"The evidence-based movement in the health sciences" is not the scientific method. It's a movement.

Comment author: Lumifer 11 March 2016 06:04:55PM 0 points [-]

It's a movement to use the scientific method.

Comment author: philh 11 March 2016 06:10:37PM 4 points [-]

Right, but criticising the movement isn't the same thing as criticising the scientific method.

For example, doors the writer believe that the movement actually succeeds in applying the scientific method?

To be fair, I haven't checked out the source, and I'm unlikely to, on mobile. The quote doesn't establish what you want to say, but maybe the source does, and I should have considered that in my first reply.

Comment author: Lumifer 11 March 2016 06:29:58PM 1 point [-]

doors the writer believe that the movement actually succeeds in applying the scientific method?

The writer is interested in power structures and fighting the fascists:

Because ‘regimes of truth’ such as the evidence-based movement currently enjoy a privileged status, scholars have not only a scientific duty, but also an ethical obligation to deconstruct these regimes of power.

As far as I can see, basically the authors of the paper want decouple the idea of "truth" from empirical reality and evidence. Demanding evidence to support your claims is an act of oppression and intolerance.

Comment author: ChristianKl 19 March 2016 06:51:35PM *  1 point [-]

As far as I can see, basically the authors of the paper want decouple the idea of "truth" from empirical reality and evidence.

That's not true. The ‘regimes of truth’ used by judges at court don't decouple truth from empirical reality and evidence. At the same time it's not the same ‘regime of truth’ used in EBM. They argue against monoculture and that there's one standard of truth that everybody in science has to follow.

That not only means that the existing questions might get biased answers but also that important questions don't get scientific investigation because they are not interesting in the EBM paradigm. That's classic Kuhn. Scientific paradigms not only determine answers but also questions and old questions often get forgotten with new paradigms.

They bring the question: `How should a woman assign meaning to the diagnosis she just received that, genetically, she has a 40% probability of developing breast cancer in her lifetime? What will this number mean in real terms, when she is asked to evaluate the meaning of such personal risk in the context of her entire life, a life whose value and duration are themselves impossible factors in the equation?`

Under classic EBM that's not a question about which you can write a scientific paper.

Comment author: Lumifer 21 March 2016 02:56:27PM *  0 points [-]

that there's one standard of truth that everybody in science has to follow.

Yes, I think that's about correct -- there should be.

because they are not interesting

Whether a question is "interesting" has nothing to do with single or multiple standards of truth.

The bring the question: `How should a woman assign meaning..."

That's not a question for science. It's a question for a psychotherapist, lay or professional.

that's not a question about which you can write a scientific paper

Correct and I like it this way. Not everything has to be science.

Comment author: ChristianKl 21 March 2016 10:12:57PM 0 points [-]

Yes, I think that's about correct -- there should be.

In high-energy physics there seems to be a 5-sigma standard. Does that mean that climate scientists shouldn't say they found strong evidence for global warming when climate scientists don't have 5-sigma's? No. It's quite alright for the climate scientists to use different standards.

Bioinformatics isn't part of medical statistics because the bioinformatics community uses different standards of evidence. It least that's how my statistics professor explained why a distinct bioinformatics community developed.

When we look at 23andMe we see the conflicts of those standards. Risk profiles developed by 23andMe are reasonable from a bioinformatics perspective. At the same time they don't fulfill the values of the medical statistics community.

Science doesn't profit from forcing the same standards on everyone. That doesn't mean that the FDA can't have a uniform standards for approving drugs but the scientific community as a whole benefits from plurality.

Whether a question is "interesting" has nothing to do with single or multiple standards of truth.

That might be true, but is besides the point. Their claim doesn't focus on standards of truth but on regimes of truth, with they equate with Kuhn's term paradigm.

The fact that Kuhnian paradigm change comes with a change of the questions that interest scientists, seems to be well-established to me. Do you think that's wrong?

That's not a question for science. It's a question for a psychotherapist, lay or professional.

How does that make the question non-scientific? Do you consider psychotherapy a non-scientific field?

Saying that the question isn't scientific also opens up the area for lunatics. There are pro-life Christians who's insistance on doing everything to keep people alive results in old people getting effectively tortured. Our society would profit if we had good scientists who would work on the topic of how to provide old people a dignified way to die.

Comment author: Lumifer 21 March 2016 11:49:44PM *  3 points [-]

In high-energy physics there seems to be a 5-sigma standard. Does that mean that climate scientists shouldn't say they found strong evidence for global warming when climate scientists don't have 5-sigma's?

You are still confused.

In the context of this thread the standard that we are talking about is the standard of the objective reality. Things are measured and evaluated by how well they match the reality. This is the standard -- common to physicists and (hopefully, though I have my doubts) climate scientists.

different standards of evidence

Still confused.

Here you are not even talking about standards of evidence (which determine what kind of evidence would you find acceptable). You are talking about standards of proof where "proof" is defined as "enough to convince us to accept the following as true". That can certainly be different in different fields. Even from the theoretical-optimal point of view, it should vary depending on how much you stand to gain if the hypothesis turns out to be actually true and how much you stand to lose otherwise.

The standard of proof for physicists is five sigmas, usually.

But those are not the standards about which we are talking in this thread.

Do you consider psychotherapy a non-scientific field?

Yes. At best it's at a proto-science stage, trying to gather evidence. I don't think it had much success in systematising it yet.

Our society would profit if we had good scientists who would work on the topic of how to provide old people a dignified way to die.

No, I don't think so. In fact, I think it would be very harmful for the society to decide that there is a single, objective, "scientific" dignified way to die.

Comment author: ChristianKl 19 March 2016 06:53:51PM 0 points [-]

They usually don't care about scientific method at all, because they see this whole process as a fight between the good side and the evil side, and the scientific method itself is a part of the evil side.

No. The would go after Kuhn and the majority of people who investigated scientifically what scientists do and say that there isn't one method that can be called the scientific method. The standard HPS belief is that scientists in different fields use different methods.