= 27d567bc2d48d9f40e9ccc20ea370b15)
Manfred comments on Some Heuristics for Evaluating the Soundness of the Academic Mainstream in Unfamiliar Fields - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
Comments (272)
If you are going to suggest that academic climate research is not up to scratch, you need to do more than post links to pages that link to non-academic articles. Saying "you can find lots on google scholar" is not that same as actually pointing to the alleged sub-standard research.
For a long time I too was somewhat skeptical about global warming. I recognized the risk that researchers would exaggerate the problem in order to obtain more funding.
What I chose to do to resolve the matter was to deep dive into a few often-raised skeptic arguments using my knowledge of physics as a starting point, and learning whatever I needed to learn along the way (it took a while). The result was that the academic researchers won 6-0 6-0 6-0 in three sets (to use a tennis score analogy). Most striking to me was the dishonesty and lack of substance on the "skeptic" side. There was just no "there" there.
The topics I looked into were: accuracy of the climate temperature record, alleged natural causes explaining the recent heating, the alleged saturation of the atmospheric CO2 infra-red wavelengths, and the claim that the CO2 that is emitted by man is absorbed very quickly.
In retrospect I became aware that my 'skepticism' was fulled in large part by deliberate misinformation campaigns in the grand tradition of tobacco, asbestos, HFCs, DDT etc. The same techniques, and even many of the same PR firms are involved. As one tobacco executive said "Our product is doubt".
An article about assessing the soundness of the academic mainstream would benefit from also discussing the ways in which the message from, and even the research done in, academia is corrupted and distorted by commercial interests. Economics is a case in point, but it is a big issue also in drug research and other aspects of medicine.
Another thing I have noticed in looking into various areas of academic research is just how much research in every field I looked at is inconclusive, inconsequential, flawed or subtly biased (look up "desk drawer bias" for example).
Edit: fixed a few typos.
Edit: good article by the way, very well reasoned.
Speaking of which, smoking, asbestos, and pesticides are good examples of the venal interest heuristic where the most respected people on the academic side are pretty damn correct.
Manfred:
I don't think this is an accurate analysis. Venal interests are relevant when they have ways of influencing researchers in ways that won't make it look like immediately obvious fraud and crude malfeasance, which the modern academic system is indeed very good at stamping out.
If a researcher benefits from affiliation with some individuals or institutions and in turn produces research benefiting these parties, thus forming a suspiciously convenient symbiotic relationship, it will work in practice only if this relationship is somehow obscured. Sometimes it is obscured by channeling funding through neutral-looking third parties and similar swindles, but again, this is difficult to pull off in a way that won't raise all sorts of red flags in the present system. A far more serious and common problem, in my opinion, is when the relationship is completely in the open -- often even boasted about -- because the institutions involved have such high status and exalted image that they're normally perceived as worthy of highest trust and confidence in their objectivity and benevolence.
I mostly agree, but I think there's a continuous scale here, not a general rule. The situation of pesticide companies and pharmaceutical companies is very similar, and both have used similar tactics to try and corrupt the science around them, but pharmaceutical companies have been much more effective - probably by spending much more money.
I don't think the amount of money is relevant in this particular comparison. Far more important is the ability of the corrupting special interest to assume the forms and establish the social and legal status enabling it to present itself as a legitimate patron of scholarship, association with which won't be detrimental to the researchers' reputation. Money clearly doesn't hurt in this endeavor, but I think that it's far from being the most important factor.
Can you spell this out some more, focusing on this example? I'm looking for criteria which can be applied in advance to predict the degree of success of special interest propaganda.
Does the social and legal status and legitimacy of pharmaceuticals, as against pesticides, simply reflect the greater prestige of doctors over farmers?
torekp:
In this case, I think that's a correct hypothesis. The medical profession -- and by extension all the related professions in its orbit, to varying extents -- certainly enjoys such a high-status public perception that people will be biased towards interpreting its official claims and acts as coming from benevolent and objective expertise, even when a completely analogous situation in some ordinary industry or profession would be met with suspicion. Thus, it seems eminently plausible that in medical and related research people can let themselves be influenced by much more venal interest than usual, thinly disguised and rationalized as neutral and objective expertise and beneficial cooperation.
In my opinion, however, this is not where the worst problem lies. As long as the beneficiaries of biased research are easy to identify, one at least has a straightforward way to start making sense of the situation. A much worse problem is when the perverse incentives have a more complex and impersonal bureaucratic structure, in which ostensibly there are no private profits and venal interests, merely people working according to strict standards of professional ethics and expertise, but in reality this impeccable bureaucratic facade hides an awful hierarchy of patronage and the output is horrible nonsense with the effective purpose of rationalizing and excusing actions out of touch with reality. In these situations, venal interests effectively blend with ideological ones, and with all their elaborate and impressive bureaucratic facade, they are very difficult to recognize and analyze correctly.
You are right. However it is worth noting the powerful forces that are arrayed against any researcher who threatens powerful economic interests.
Given how much research is funded by the government, it is very possible for those with the right connections to punish those who do not sing the right song.
The story of trans fats is a good case in point, well documented in Gary Taubes's book. Good Calories Bad Calories.