Tetlock's political judgment study was a test for macroeconomics, political science and history. Yet people with PhDs in these areas did no better on predicting macro political and economic events than those without any PhD. Maybe macro helps in producing good econometric models, but it doesn't help in making informal predictions. (Whereas one suspects that physics and chemistry would help in a test of quick predictions about a novel physical or chemical system, vs. people without a PhD in these fields).
While cognitive-behavioral therapy could in some ways be characterized as an offshoot of the philosophy known as Stoicism (which oddly seems to have "lucked into" quite a set of effective beliefs, especially when compared to most other philosophies) rather than an offshoot of psychology, the psychological research process and psychological theory as a whole have definitely acted to inform and refine CBT.
I was looking for someone to specify a well supported psychological theory that predicts that CBT should be effective. What's the theory, and what's the evidence that people believed it before CBT came along?
I also think Shulman's example of IQ is different from the physics/chemistry case. It was discovered that scores on a short IQ test predicted long-term job performance on a range of tasks. Organizations that used IQ in hiring were then able to obtain better long-term job performance. But IQ was not something that was predicted from a model of how the brain or mind works. Even now, a century after the development of IQ tests, I'm not sure we have a good bottom up account of why a few little reasoning questions can be as informative about human cognitive performance as IQ seems to be. (Not saying that IQ gives you all the information you want, but a few short questions provide a surprising amount of information).
Re: your examples successful spin-offs for psychology, to what extent did these therapies come out of well-established theory? Maybe someone can weigh in here. It seems possible that these are good therapies but ones that don't have a strong basis in theory (in contrast to technologies from physics or chemistry).
View more: Prev
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)
Two issues with this heuristic:
1) It doesn't work well for credence goods.
2) Sometimes it takes a long time for sciences to find an application, two modern examples are astrophysics, and particle physics.
(2) is a useful point, but doesn't generalize fully. To take your own examples, if some theories in astrophysics and particle physics were extremely well supported by the standards of physics, then the lack of spinoffs would not undermine them very much. If the theories are well supported, then they've made lots of novel predictions that have been verified. That a particular spinoff works is just evidence that a particular novel prediction is verified.