SilasBarta comments on Even if you have a nail, not all hammers are the same - Less Wrong

95 Post author: PhilGoetz 29 March 2010 06:09PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (125)

You are viewing a single comment's thread. Show more comments above.

Comment author: cupholder 30 March 2010 06:26:08PM 3 points [-]

I run into this problem every time I read anything on health or medicine (it seems limited to these topics).

This is an interesting point in itself. Why health and medicine?

Maybe causal inference is straight up more difficult in health and medicine: effects are smaller and more ambiguous than in hard sciences, and have many hard-to-manipulate causes that blur the signal.

There are borderline results in fields like physics, obviously, but they're usually more esoteric and tend to have relatively clear cut theory behind them (which is why I'd guess you're not too worried about, say, last year's ambiguous results from the Cryogenic Dark Matter Search), so they don't provoke so much back-and-forthing.

This leads me to a prediction: you'd have as much difficulty reading up on results in psychology and sociology as you do in health and medicine. As for what to do about it? Uh...not sure. I'm still chewing over this thread.

Comment author: SilasBarta 30 March 2010 06:43:45PM *  8 points [-]

This is an interesting point in itself. Why health and medicine?

Maybe causal inference is straight up more difficult in health and medicine: effects are smaller and more ambiguous than in hard sciences, and have many hard-to-manipulate causes that blur the signal.

My self-serving explanation is that health/ medicine/ biology select for people who enjoy (or better tolerate) rote memorization (Levels 0-1 in my hierarchy) rather than "how it works"-type understanding (Levels 2-3). This gets the group of intelligent people with worse ability to know the broader meaning of what they're doing, a skill that tends to curtail questionable statistical practices.

Yes, I know it sounds insulting, but what really turned me off from taking more biology in high school and college, and from med school, is that it's so much more memorization-oriented rather than generative-model oriented. This suspicion is confirmed when I hear about e.g. ecologists just now getting around to using the method of adjacency matrix eigenvectors (i.e., Google's PageRank) to identify key organisms in ecosystems.

Comment author: PhilGoetz 30 March 2010 10:18:09PM *  8 points [-]

And an alternate alternate explanation: Poor priorities. Doctors want to hear all the clinical details, and are mentally worn out by the time they finish with those. There's just no time or energy to do the math too.

When I used to work for NASA in theoretical air traffic management, I'd try to explain some abstract point about turbulent or chaotic traffic flow to operational FAA guys, and they would get bogged-down in details about what kind of planes we were talking about, what altitudes they were flying at, which airlines they belonged to, and on and on.

Comment author: Jack 30 March 2010 10:40:01PM 2 points [-]

What is theoretical air traffic management?

I mean, in more detail than I can glean just from knowing what those words mean.

Comment author: PhilGoetz 31 March 2010 02:52:23AM *  5 points [-]

You won't hear that phrase, but I mean the theoretical study of air traffic. For instance, I studied "free flight", which is when airplanes can fly directly from their takeoff airport to their landing airport and manage their own collision-avoidance, and showed that in certain free-flight situations you can increase the throughput of the airspace by reducing the information that you give to pilots.

It's an interesting general phenomenon: They try to optimize their route using all of their information. So the more information they have, the more unpredictable their behavior is. More information can actually cause more trouble than it solves in some cases, at least when it's information about what other agents are doing.

I had a contract from NASA to look for chaotic behavior in en-route air traffic, but my conclusion was that it is unlikely and nothing need be done to avoid it at present.

Comment author: gwern 03 April 2010 01:18:28AM 1 point [-]

showed that in certain free-flight situations you can increase the throughput of the airspace by reducing the information that you give to pilots.

Reminds me of Braess's paradox; a route people don't know about is similar to one that doesn't exist.

Comment author: PhilGoetz 30 March 2010 10:05:17PM *  4 points [-]

Here's an alternate insulting explanation, based on many (but not all) of the doctors I've met:

Doctors are bad at being unsure of themselves.