You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

V_V comments on Open Thread, April 27-May 4, 2014 - Less Wrong Discussion

0 Post author: NancyLebovitz 27 April 2014 08:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (200)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 28 April 2014 08:07:18PM *  20 points [-]

60-yo men die all the time; anytime someone who writes on diet dies, someone is going to say 'I wonder if this proves/disproves his diet claims', no matter what the claims were or their truth. They don't, of course, since even if you had 1000 Seth Roberts, you wouldn't have a particularly strong piece of evidence on correlation of 'being Roberts' and all-cause mortality, and his diet choices were not randomized, so you don't even get causal inference. More importantly, if Roberts had died at any time before his actuarial life expectancy (in the low 80s, I'd eyeball it, given his education, ethnicity, and having survived so long already), people would make this claim.

OK, so let's be a little more precise and play with some numbers.

Roberts published The Shangri-la Diet in 2006. If he's 60 now in 2014 (8 years later), then he was 52 then. Let's say people would only consider his death negatively if he died before his actuarial life expectancy, and I'm going to handwave that as 80; then he has 28 years to survive before his death stops looking bad.

What's his risk of dying if his diet makes zero difference to his health one way or another? Looking at http://www.ssa.gov/OACT/STATS/table4c6.html from 52-80, the per-year risk of death goes from 0.006337 to 0.061620. What's the cumulative risk? We can, I think, calculate it as (1 - 0.06337) * ... * (1 - 0.061620). A little copy-paste, a little Haskell, and:

> foldr1 (*) $ map (1-) [0.006337,0.006837,0.007347,0.007905,0.008508,0.009116,0.009723,
0.010354,0.011046,0.011835,0.012728,0.013743,0.014885,0.016182,
0.017612,0.019138,0.020752,0.022497,0.024488,0.026747,0.029212,
0.031885,0.034832,0.038217,0.042059,0.046261,0.050826,0.055865,
0.061620]
0.5065374918662645

So roughly speaking, Roberts had maybe a 50% chance of surviving from publishing his diet book to a ripe old age. (Suppose Roberts's ideas had halved his risk of death in each time period, which we can implement with a call to map (/2). It's not quite as simple as dividing 50% by 2, but when you rerun the probability, then he'd have a 71% chance of survival, or more relevantly, he still has a 29% chance of dying in that timespan.)

In summary: Life sucks, and diet gurus can be expected to die all the time no matter whether their ideas are great or horrible, so their deaths tell us so little that discussing it at all is probably biasing our beliefs through an anchoring or salience effect.

Comment author: V_V 29 April 2014 09:28:57PM *  1 point [-]

So roughly speaking, Roberts had maybe a 50% chance of surviving from publishing his diet book to a ripe old age.

If his actuarial life expectancy was 80 and he had died at 79 it wouldn't have looked particularly suspicious. But according to your data, his probability of dying between 52 and 60 was only about 7.5%, which is not terribly low, but still enough to warrant reasonable doubt, especially considering the circumstances of his death.

Comment author: brazil84 04 May 2014 05:51:22PM *  1 point [-]

But according to your data, his probability of dying between 52 and 60 was only about 7.5%, which is not terribly low, but still enough to warrant reasonable doubt, especially considering the circumstances of his death.

I think the more interesting question is the probability of a man in his age range (who is not obese; not a smoker; and has no serious self-reported history of health problems) suddenly collapsing and dying. I don't know the answer to this question, but it's a pretty unusual event.

By the way, here is a video of Seth Roberts speaking about his butter experiment a few years ago. Seth Roberts mentions that he eats a half a stick of butter a day on top of his Omega-3 regimen. (And probably this is on top of daily consumption of raw olive oil).

http://vimeo.com/14281896

At around 11:00, an apparent cardiologist concedes that the butter regimen may very well improve brain function but he warns Roberts that he is risking clogging up the arteries in his brain and points out that Roberts brain function won't be so great if he has a stroke. Roberts is pretty dismissive of the comment and points out that there is reason to believe the role of fat consumption in atherosclerosis over-emphasized or mistaken.

Still, if someone suddenly collapses and dies, from what I understand it's usually a cardiovascular problem -- a blood clot; stroke; aneurism; heart attack, internal bleeding, etc. And Roberts was consuming copious amounts of foods which are widely believed to have a big impact on the cardiovascular system.

It's silly to ignore this information when assessing probabilities. Here's an analogy: Suppose that Prince William has a newborn son and you are going to place a bet on what the child's name will be. You might reason that the most common male given name in the world is "Mohamed" and therefore the smart money is on "Mohamed." Of course you would lose your money.

The flaw in this type of reasoning is that when assessing probabilities, there is a requirement that you use all available information.

I imagine Gwern would respond that he is merely setting an upper bound. But that's silly and pointless too. If 90% of male children in Saudi Arabia are named "Mohamed," we can infer that the probability the Royal Baby will be named "Mohamed" does not exceed 90%. But so what? That's trivial.

Comment author: gwern 29 April 2014 11:28:25PM *  0 points [-]

but still enough to warrant reasonable doubt, especially considering the circumstances of his death.

I disagree (reasonable doubt under what assumptions? in what model? can you translate this to p-values? would you take that p-value remotely seriously if you saw it in a study where n=1?), and I've already pointed out many systematic biases and problems with attempting to infer anything from Roberts's death.

Comment author: Douglas_Knight 30 April 2014 03:29:46AM 2 points [-]

Isn't the p-value simply 100%-7.5%?

Comment author: V_V 30 April 2014 07:21:05AM 1 point [-]

I'm not saying we can scientifically infer from his premature death that his diet was unhealthy.

I'm saying that his premature death is informal evidence that his diet at best didn't have a significant positive impact on life expectancy, and at worst was actively harmful. I can't quantify how much, but you were the one who attempted a quantitative argument and I've just criticized your argument, namely your strawman definition of "suspicious death", using your own data and assumptions, hence it seems odd that you now ask me for assumptions and p-values.