gwern comments on Is Sunk Cost Fallacy a Fallacy? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (80)
Focusing money too closely on the research itself runs the risk that you'll end up paying for a lot of hot air dressed up to look like research. Cool-but-useless real-world applications are the costly signalling mechanism which demonstrates an underlying theory's validity to nonspecialists. You can't fly to the moon by tacking more and more epicycles onto the crystalline-sphere theory of celestial mechanics.
If you want to fly to the moon, buy flying to the moon. X-prizes etc. You still haven't shown that indirect mechanisms which happen to coincide with the status quo are the optimal way of achieving goals.
"Modern-day best-practices industrial engineering works pretty well at it's stated goals, and motivates theoretical progress as a result of subgoals" is not a particularly controversial claim. If you think there's a way to do more with less, or somehow immunize the market for pure research against adverse selection due to frauds and crackpots, feel free to prove it.
I disagree. I don't think there's any consensus on this. The success of prizes/contests for motivating research shows that grand follies like the Concorde or Apollo project are far from the only effective funding mechanism, and most of the arguments for grand follies come from those with highly vested interests in them or conflicts of interest - the US government and affiliated academics are certainly happy to make 'the Tang argument' but I don't see why one would trust them.
I didn't say it was the only effective funding mechanism. I didn't say it was the best. Please respond to the argument I actually made.
You haven't made an argument that indirect funding is the best way to go and you've made baseless claims. There's nothing to respond to: the burden of proof is on anyone who claims that bizarrely indirect mechanisms through flawed actors with considerable incentive to overstate efficacy and do said indirect mechanism (suppose funding the Apollo Project was an almost complete waste of money compared to the normal grant process; would NASA ever under any circumstances admit this?) is the best or even a good way to go compared to directly incentivizing the goal through contests or grants.
On this point we are in agreement. I'm not making any assertions about what the absolute best way is to fund research.
Please be more specific.
All humans are flawed. Were you perhaps under the impression that research grant applications get approved or denied by a gleaming crystalline logic-engine handed down to us by the Precursors?
Here is the 'bizarrely indirect' mechanism by which I am claiming industrial engineering motivates basic research. First, somebody approaches some engineers with a set of requirements that, at a glance, to someone familiar with the current state of the art, seems impossible or at least unreasonably difficult. Money is piled up, made available to the engineers conditional on them solving the problem, until they grudgingly admit that it might be possible after all.
The problem is broken down into smaller pieces: for example, to put a man on the moon, we need some machinery to keep him alive, and a big rocket to get him and the machinery back to Earth, and an even bigger rocket to send the man and the machinery and the return rocket out there in the first place. The Tsiolkovsky rocket equation puts some heavy constraints on the design in terms of mass ratios, so minimizing the mass of the life-support machinery is important.
To minimize life-support mass while fulfilling the original requirement of actually keeping the man alive, the engineers need to understand what exactly the man might otherwise die of. No previous studies on the subject have been done, so they take a batch of laboratory-grade hamsters, pay someone to expose the hamsters to cosmic radiation in a systematic and controlled way, and carefully observe how sick or dead the hamsters become as a result. Basic research, in other words, but focused on a specific goal.
They seem to be capable of acknowledging errors, yes. Are you?
http://www.newscientist.com/article/dn11326
That's like asking "If homeopathy worked and all the doctors were wrong, would they admit it?" You can't just flip a bit in the world setting Homeopathy_Works to TRUE and keep everything else the same. If homeopathy worked and yet doctors still didn't accept it, that would imply that doctors are very different than they are now, and that difference would manifest itself in lots of other ways than just doctors' opinion on homeopathy.
If funding the Apollo Project was a complete waste of money compared to the normal grant process, the world would be a different place, because that would require levels of incompetency on NASA's part so great that it would get noticed.
Or for another example: if psi was real, would James Randi believe it?
No; it's like asking "If homeopathy didn't work and all the homeopaths were wrong, would they admit it?" You can find plenty of critics of Big Science and/or government spending on prestige projects, just like you can find plenty of critics of homeopathy.
If homeopathy was a complete waste of money compared to normal medicine implying 'great' levels of incompetency on homeopaths, how would the world look different than it does?
Those people generally claim that Apollo was a waste of money period, not that Apollo was a waste of money compared to going to the moon via the normal grant process.
You can look at cases like chiropractors. Over a long time there was a general belief that chiropractors didn't provide any good for patients because they theory based on which chiropractors practice is in substantial conflict with the theories used by Western medicine.
Suddenly in 2008 Cochrane comes out with the claim that chiropractors actually do provide comparable health benefits for patients with back pain as conventional treatment for backpain.
A lot of the opposition to homeopathy is based on the fact that the theory base of homeopathy is in conflict with standard Western knowledge about how things are supposed to work.
People often fail to notice things for bad reasons.
There are very good reasons why finding that one set of studies shows an unusual result is not taken as proof by either doctors or scientists. (It is also routine for pseudoscientists to latch onto that one or few studies when they happen.)
In other words, chiropractic is not such a case.
I hope you're not suggesting that the theories used by Western medicine are likely to be wrong here.
Cochrane meta studies are the gold standard. In general they do get taken as proof.
The main point is that you don't need to have a valid theory to be able to produce empirical results.
Then I'm also don't believe that issues surrounding back pain are very well understood by today's Western medicine.
"works pretty well" is not a controversial claim, but "motivates theoretical progress" is more iffy.
Offhand, I would say that it motivates incremental progress and applied aspects. I don't think it motivates attempts at breakthroughs and basic science.
'Breakthroughs and basic science' seem to be running in to diminishing returns lately. As a policy matter, I think we (human civilization) should focus more on applying what we already know about the basics, to do what we're already doing more efficiently.