Phlebas comments on [LINK] Fraud Case Seen as a Red Flag for Psychology Research - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (29)
See also: climategate.
The article discusses the refusal of the University of East Anglia to release ”CRUTEM” data under the Freedom of Information Act – on this occasion the UK Information Commissioner ruled that the university would have to comply with requests to share its data:
Quote:
As if it wasn’t already clear that this kind of behaviour (exhibited on a consistent basis) constitutes scientific misconduct, Wicherts and Bakker’s findings provide evidence that it should be so regarded.
Another interesting nugget I read about on Steve Sailer’s site – again referring to the research of Wicherts – concerned “stereotype threat”.
Quotes:
Interestingly there are many credulous references to “stereotype threat” on lesswrong, but seemingly no skeptical postures (until now).
I have been aware of the case against stereotype threat for some time, but wouldn't want to post it under my regular handle (linked to my real name and high-karma). People who try to approach these topics in an even-handed way often lose their jobs or suffer other serious consequences. Mostly I just try to let the discussion die down, since those who might present non-PC evidence are laboring under differential burdens and constraints.
Interesting. So, say, NASA, which shares its data liberally, has gotten its conclusions right, while CRU, which resisted doing so, has gotten them wrong?
Don't try to put words in my mouth, thanks.
Wicherts and Bakker's finding that failure to share data corresponds to failure to speak the truth is evidence in favour of the idea that the CRU's consistent refusal to share data is related to their being pseudo-scientists.
The fact that their line on global warming is synoptic with James Hansen’s group’s line has two parsimonious explanations: they have both discovered the truth; or they are willing to manipulate the data to prove whatever they want to prove.
Either way, the evidence in Konkvistadors’s post (presuming it is news to anyone) should reduce one’s confidence in the scientific competence of the CRU.
Not really putting words in your mouth, just trying to make sense of what you said in context of the post. It turned out to be pretty, well, normal. You're mentioning reasons that will allow you to say global warming isn't happening, not trying to evaluate claims of global warming, in general, using this heuristic.
To explain the comment about “putting words in my mouth”: my comment relating the activities of the CRU to the subject of Konkvistador’s post was to the effect that the CRU is unwilling to share data, even when it is legally obliged to do so; there is debate regarding whether this is acceptable scientific practice; and that here we have concrete evidence that failure to share data is related to bad science; therefore, in light of this finding everyone (AGW-credulist or skeptic) should take a dimmer view of the CRU’s opacity.
From the credulist point of view, it might appear that the CRU has problems with quality control, which they are trying to shield from view – perhaps their work on paleoclimatology should be handed over to the Met office, for example. This is compatible with the idea that they are right about AGW in general but CRUTEM is a mess, or even that the problems with CRUTEM are not too severe but they should be doing better.
From the skeptic (or fence-sitting) view, this is more evidence that the CRU are pseudo-scientists in general. The fact that NASA agree in general with the CRU on AGW, and NASA happen to share data, doesn’t exonerate the CRU; there are plenty of ways to lie and mislead that do not involve failing to share data, so the fact that NASA is more transparent is no guarantee that their and the University of East Anglia’s conclusions on AGW are sound in general.
Your comment implied that I had claimed that the CRU’s conclusions were necessarily wrong, because they don’t share their data; and that NASA’s conclusions in general are necessarily right, because they do share data.
This is a non-sequitur on both counts. What makes this objectionable is that you supplied no reasoning beyond a mere statement, as though these conclusions followed trivially from what I had said. This is a rhetorical technique designed to score points, rather than something I would expect from a valuable debating partner – a suitable description of this style of commenting is “putting words into someone’s mouth”, and I think that the best way of dealing with it is to refer to it directly, so as to dissociate oneself from the non-sequitur.
The hyperbole of my original reply was shorthand for "is evidence for," and I'm sorry if me doing that derailed the topic a bit by miscommunicating. The purpose of my reply was so I could get a better idea whether you were assessing claims of global warming using the tool referred to in the post ("the more reluctant that scientists were to share their data, the more likely that evidence contradicted their reported findings."), or whether you were making a related but not-covered-by-the-post argument about how CRU wasn't doing science. Your replies indicated that you were doing the latter.
The CRU has been exonerated of manipulating data or hiding information that challenged the consensus on global warming.
If they had, though, it would certainly be understandable. As with any issue that deals with a lot of motivated cognition, climate skeptics will seize on any data that will support their disbelief out of the sea of all the data that confronts it, and not revise their confidence back down if the data is retracted or shown to be false. A single study contradicting the consensus at low P-value would be no problem in a rational world, but it's a social liability in our own. But no bigger a liability than being found hiding information. Damned if you do and damned if you don't.
Noticably more damned if you do, insofar as actually being found hiding information also damages your credibility among the rest of the population.
By whom? is the important question. Having read some of the incriminating emails and the infamous harryreadme.txt I certainly don’t exonerate them.
If this is the case, I wonder why legitimate scientists never caught on to that idea in the past – defeat the skeptics by hiding data and the details of scientific practices from them. This seems 180 degrees from reality.
Creationists are often mentioned in this context – transparent scientific practices have failed to persuade them. However, this is simply because creationists are in possession of a memeplex that renders them immune to reason; hiding data and scientific information from the public would only embolden them, besides giving more rational people reason to doubt the veracity of Darwinism.
Even if there were any substance to the idea that transparency in science empowers skeptics, that is vastly outweighed by the hazards involved in permitting these people to recommend massive social and economic policy changes, without their being subject to scrutiny from outsiders (NB: peer review is not incorruptible, as the climategate emails have revealed). They can hardly claim to be minding their own business!
This is interesting, but not exactly what I'd call public evidence.
Wicherts's papers are in the public domain. Steve Sailer's link to the abstract of the talk in question is broken, the document having been moved to here.
I don't see anything on his website about the meta-analysis, except for a line on his CV saying that the paper is under review. That means all we have to go by is the one-paragraph abstract from his 2009 talk, and the report of one person who saw that talk. And the abstract, though critical of stereotype threat research, doesn't actually claim that stereotype threat does not exist.
Point taken; that particular criticism of stereotype threat is absent from the papers available on his site.
Blip's comment may shed light on reasons why the paper is yet unpublished, although YMMV.
I'll quote the abstract to clarify matters:
Edit: in the absence of the most helpful Wicherts paper, here is another paper, referred to in a longer Steve Sailer article, discussing the misinterpretation of findings in stereotype threat (particularly in pop science and the media, e.g. Malcolm Gladwell).
Quote:
The reference to "high-stakes settings" in the Wicherts abstract concerns the obvious problem that stereotype threat is rarely if ever tested in real settings (e.g. college admissions) because this would be unethical. But if the test is meaningless and the subject is smart enough to figure out what the experimenter is hoping to prove, the potential source of bias is obvious.