LESSWRONG
LW

Comment Permalink

If one party is espousing a hypothesis which has a very low prior probability, then they suffer the burden of providing evidence to support this hypothesis. Finding evidence takes time and resources; if you want to support the low probability hypothesis, then you spend the resources.

[anonymous]11y00

a hypothesis which has a very low prior probability

if you want to support the low probability hypothesis, then you spend the resources.

You should spend the resources when there is high value of information, otherwise do something else. Improving someone else's beliefs may have high value for them.

[This comment is no longer endorsed by its author]Reply

0[anonymous]11y

If you want to [test] a low [value of information] hypothesis, you change your mind and stop wanting that. What happens is that people disagree on the probabilities.

See in context

1 Open Thread, April 27-May 4, 2014

by NancyLebovitz

27th Apr 2014

1 min read

206

1 You know the drill - If it's worth saying, but not worth its own post (even in Discussion), then it goes here.

And, while this is an accidental exception, future open threads should start on Mondays until further notice.

Open Threads

Personal Blog

1

Mentioned in

6Open Thread, May 5 - 11, 2014

Open Thread, April 27-May 4, 2014

New Comment

206 comments, sorted by

top scoring

Click to highlight new comments since: Today at 9:13 AM

Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings

[-]Omid11y180

Seth Roberts is dead .

I was considering the Shangri-La diet, but now I'm nervous.

6Gary_Drescher11y

According to information his family graciously posted to his blog, the cause of death was occlusive coronary artery disease with cardiomegaly. http://blog.sethroberts.net/

1A1987dM11y

Does that make it more likely or less likely that his death was related to his diet?

6NancyLebovitz11y

The commenters are more concerned about the possible effects of high doses of omega-3.

4Stabilizer11y

This is really sad. He definitely was something else when it came to self-experimentation.

1David_Gerard11y

The blog's now disappeared. Archive copy.

3NancyLebovitz11y

His blog is back-- it's had occasional down time for a while. The archive copy was down, though. Probably a good idea to save anything you think is especially important.

0ChristianKl11y

It's very sad news and I still ask myself what to make of it. Seth influenced my own QS journey a lot. In the end the it seems like extrapolating health from the kind of data he gathered wasn't possible.

-1NancyLebovitz11y

His approach would be expected to optimize for common situations, which may not be the same as optimizing for rare situations. I've been working on a theory that health is not a single thing. For all I know, he had some intrinsic cardio-vascular problems, and his self-experimentation led to him living longer than he otherwise would have.

2ChristianKl11y

That an interesting way of phrasing the sentence. The issue is that Seth himself based his behavior on the idea that health is a bit like intelligence and it's possible to generalize from a few factors most of the useful information.

0brazil8411y

Intuitively, it seems likely to me that his death is related to one or more of his self-experiments with supplements. This is based on the observation that it's pretty unusual for 60 year old men to collapse and die, particularly if they have no serious self-reported health problems. Calculating an actual probability seems like it would be pretty hard. Edit: I suppose there is also an outside chance that this is a hoax. Has the death been reported in any newspapers?

[-]gwern11y280

60-yo men die all the time; anytime someone who writes on diet dies, someone is going to say 'I wonder if this proves/disproves his diet claims', no matter what the claims were or their truth. They don't, of course, since even if you had 1000 Seth Roberts, you wouldn't have a particularly strong piece of evidence on correlation of 'being Roberts' and all-cause mortality, and his diet choices were not randomized, so you don't even get causal inference. More importantly, if Roberts had died at any time before his actuarial life expectancy (in the low 80s, I'd eyeball it, given his education, ethnicity, and having survived so long already), people would make this claim.

OK, so let's be a little more precise and play with some numbers.

Roberts published The Shangri-la Diet in 2006. If he's 60 now in 2014 (8 years later), then he was 52 then. Let's say people would only consider his death negatively if he died before his actuarial life expectancy, and I'm going to handwave that as 80; then he has 28 years to survive before his death stops looking bad.

What's his risk of dying if his diet makes zero difference to his health one way or another? Looking at http://www.ssa.gov/OACT/STATS/table4... (read more)

5brazil8411y

Agreed. Not sure about that, for example if he had died at the age of 81 in a car accident. Although I appreciate your effort, I am not sure that you have the reference class of events correct. The evidence suggest that Roberts died (1) suddenly; (2) due to failure of some bodily system; (3) at an age which is well under his life expectancy. The prior probability of this happening has got to be far less than the prior probability of him simply dying from any cause before his actuarial life expectancy. At the same time, he was apparently consuming large amounts of butter, omega fatty acids from flax seeds, and other esoteric things. Of course it's difficult to even being estimating the risk inherent in doing such things. Ironically, Seth Roberts was a big believer in "n=1 experiments." Do you have an estimate of the probability that Robert's death is related to his supplement regime?

2gwern11y

The all-cause mortality figures were chosen for convenience. I'm sure one could dig up more appropriate figures that exclude accident, homicide, etc. But the reference class is still going to be pretty broad: if Roberts had committed suicide, had developed cancer, had a stroke rather than heart attack (or whatever), had a fall, people would be speculating on biological roots ('perhaps he was going senile thanks to the oils' or 'he claimed the flax seed oil was helping balance, but he fell all the same!'). And I'm not sure that the better figures would be that much lower: this isn't a young cohort - few elderly people are murdered or die in car accidents, AFAIK, and mortality is primarily from diseases and other health problems. As I've pointed out, the prior is quite high that he would die in a 'suspicious' way. No, and I refuse to give one on a problem which reflects motivated cognition on the part of many people based on heavily-selected evidence & post hoc reasoning. Any estimate would anchor me and bias my future thinking on diet matters. The story is far too salient, the evidence far too weak.

0brazil8411y

I would have to agree with that, however some causes of death are more suspicious than others. In this case, he died apparently died suddenly, at an age where sudden death is rather unusual in people with no self-reported history of serious health problems. Also, this kind of sudden death is usually the result of cardiovascular problems, i.e. heart attack or stroke. Last, he was known to be regularly consuming a lot of concentrated fat on a regular basis (half a stick of butter a day; and perhaps olive oil and flax seed on top of it); fatty foods have long been suspected as playing a role in cardiovascular problems, that they cause lipids to build up in the blood stream and clog up the works. It would be very tricky to do the equations, if it's possible at all, but it seems reasonable to think it's likely that his supplement regimen played a role in his demise. Well do you agree that what happened is more 'suspicious' than if he had died at the age of 75 from lung cancer? Suit yourself, but it strikes me as confusing that I would make a claim and you would respond with a calculation which seems to address the claim but actually doesn't. It makes me think you are trying to subtly change the subject. Which is fine, but I think you should be explicit about it. Otherwise it seems like you are attacking a strawman.

6gwern11y

Again, this is post hoc reasoning conjured upon observing the exact particulars of his death, and so suspect even without considering additional questions like whether fat is all it's cracked up to be, what his medical tests were saying, etc. Yes. My calculation addresses a major part of the Bayesian calculation: the probability of an observed event ('death') conditional on the hypothesis ('his diet is harmful') being false. Since dying aged 52-80 is so common, that sharply limits how much could ever be inferred from observing dying.

2brazil8411y

Actually I don't know the exact particulars of the death. But I do agree with what I think is your basic point here -- it's extremely easy to make these sorts of connections with the benefit of hindsight and that ease might be coloring my analysis. At the same time, I do think that -- in fairness -- the death is pretty high on the 'suspicious' scale so I stand by my earlier claim. Perhaps, but it seems to me you are throwing the baby out with the bathwater a bit here by ignoring the facts which make this death quite a bit more 'suspicious' than other deaths of men in that age range. More importantly, you don't seem to dispute that your calculation doesn't really address my claim. Look, I agree with your basic point -- the premature death of a diet guru, per se, doesn't say much about the efficacy or danger of the diet guru's philosophy. No calculation is necessary to convince me.

5gwern11y

I did dispute that: (A simple countermeasure to avoid biasing yourself with anecdotes: spend time reading in proportion to sample size. So you're allowed to spend 10 minutes reading about Roberts's 1 death if you then spend 17 hours repeatedly re-reading a study on how fat consumption did not predict increased mortality in a sample of 100 men.)

0brazil8411y

I wouldn't call it "major" because (1) you refuse to assign a probability to an event I stated I thought was likely; and (2) the main point of your calculation was pretty non-controversial and even without a calculation I doubt anyone would seriously dispute it. Let's do this: Is there anything I stated with which you disagree? If so, please quote it. TIA.

0gwern11y

It puts an upper bound as I said. Plug the specific conditional I calculated into Bayes theorem and see what happens. Or look at a special case: suppose conditional on the diet not being harmful, Roberts had a 50% chance of dying before 80; now, what is the maximal amount in terms of odds or decibels or whatever that you could ever update your prior upon observing Roberts's death assuming the worsened diet risk is >50%? Is this a large effect size? Or small? (Now take into account everything you know about correlations, selection effects, the plausibility of the underlying claims about diet, what is known about Roberts's health, how likely you are to hear about deaths of diet gurus, etc...) One would think so.

-2brazil8411y

So what? One can trivially put an upper and lower bound on any probability: No probability can exceed 1 or be lower than 0. But it ain't "major" to say so. On the contrary, it's trivial. Anyway, please answer my question: Was there anything in my original post with which you disagreed? If so, please quote it. TIA.

0[anonymous]11y

Your countermeasure seems to recommend never reading fiction. Feature or bug?

2NancyLebovitz11y

Seth Roberts' last article Some ambiguity about the Agatston score Agatston's overview of his test

0brazil8411y

Thank you for your post, which raises some interesting questions. Of course at this point it is not known if Roberts died of a heart attack, although the smart money is on a cardio-vascular problem - heart attack, stroke, aneurism, etc. The first question is whether the Agatston score is as good as it's made out to be by Doctor Agatston. Another question is whether it is skillful in the case of Roberts himself. Probably none of the people who were studied were eating half a stick of butter a day, along with lots of flax seeds, extra light olive oil, and who knows what else.

0V_V11y

I'm not a doctor, but a quick search on Wikipedia turns up that the most common cause of sudden death in people over 30 is coronary artery atheroma (arteriosclerosis), but other common causes are genetically determined or at least have a significant genetic component. I suppose some of these are easier to detect (hypertrophic cardiomyopathy perhaps?), so we can probably rule them out for somebody like Roberts who constantly monitored his health and bragged about how healthy he was. Other conditions are probably more difficult to detect with standard tests.

0brazil8411y

The puzzle has a lot of pieces missing, to be sure. Another question is whether Roberts was telling the whole truth about his health. Or about his diet for that matter. It's even not out of the question that he has gained a lot of weight.

0V_V11y

If his actuarial life expectancy was 80 and he had died at 79 it wouldn't have looked particularly suspicious. But according to your data, his probability of dying between 52 and 60 was only about 7.5%, which is not terribly low, but still enough to warrant reasonable doubt, especially considering the circumstances of his death.

0brazil8411y

I think the more interesting question is the probability of a man in his age range (who is not obese; not a smoker; and has no serious self-reported history of health problems) suddenly collapsing and dying. I don't know the answer to this question, but it's a pretty unusual event. By the way, here is a video of Seth Roberts speaking about his butter experiment a few years ago. Seth Roberts mentions that he eats a half a stick of butter a day on top of his Omega-3 regimen. (And probably this is on top of daily consumption of raw olive oil). http://vimeo.com/14281896 At around 11:00, an apparent cardiologist concedes that the butter regimen may very well improve brain function but he warns Roberts that he is risking clogging up the arteries in his brain and points out that Roberts brain function won't be so great if he has a stroke. Roberts is pretty dismissive of the comment and points out that there is reason to believe the role of fat consumption in atherosclerosis over-emphasized or mistaken. Still, if someone suddenly collapses and dies, from what I understand it's usually a cardiovascular problem -- a blood clot; stroke; aneurism; heart attack, internal bleeding, etc. And Roberts was consuming copious amounts of foods which are widely believed to have a big impact on the cardiovascular system. It's silly to ignore this information when assessing probabilities. Here's an analogy: Suppose that Prince William has a newborn son and you are going to place a bet on what the child's name will be. You might reason that the most common male given name in the world is "Mohamed" and therefore the smart money is on "Mohamed." Of course you would lose your money. The flaw in this type of reasoning is that when assessing probabilities, there is a requirement that you use all available information. I imagine Gwern would respond that he is merely setting an upper bound. But that's silly and pointless too. If 90% of male children in Saudi Arabia are named "Mohamed," we c

0gwern11y

I disagree (reasonable doubt under what assumptions? in what model? can you translate this to p-values? would you take that p-value remotely seriously if you saw it in a study where n=1?), and I've already pointed out many systematic biases and problems with attempting to infer anything from Roberts's death.

2V_V11y

I'm not saying we can scientifically infer from his premature death that his diet was unhealthy. I'm saying that his premature death is informal evidence that his diet at best didn't have a significant positive impact on life expectancy, and at worst was actively harmful. I can't quantify how much, but you were the one who attempted a quantitative argument and I've just criticized your argument, namely your strawman definition of "suspicious death", using your own data and assumptions, hence it seems odd that you now ask me for assumptions and p-values.

2Douglas_Knight11y

Isn't the p-value simply 100%-7.5%?

0ChristianKl11y

Yes fittingly from Ryan Holiday: http://betabeat.com/2014/04/personal-science-pioneer-seth-roberts-passes-away/ But I don't think a normal newspaper would do more fact checking then the people who read Seth's blog and comment on it.

[-]jaime200011y150

I just graduated from FIU with a bachelor's in philosophy and a minor in mathematics. I'd like to thank my parents, God and Eliezer Yudkowsky (whose The Sequences I cited in each of the five papers I had to turn in during my final semester).

[-]Prismattic11y190

I can't tell whether the serial comma joke here is intentional.

3Shmi11y

Grats! Hope you have a job lined up. Redundant? Mutually exclusive? I can't decide.

9arundelo11y

A reference to this example of why to use the Oxford comma.

[-]Punoxysm11y140

I have to say, I seriously don't get the Bayesian vs Frequentist holy wars. It seems to me the ratio of importance to education of its participants is ridiculously low.

Bayesian and frequentist methods are sets of statistical tools, not sacred orders to which you pledge a blood oath. Just understand the usage of each tools, and the fact that virtually any model of something that happens in the real world is going to be misspecified.

6Oscar_Cunningham11y

It's because Bayesian methods really do claim to be more than just a set of tools. They are supposed to be universally applicable.

5Tenoke11y

This is a bit of an exaggeration. Additionally, you are only talking about the 'sets of statistical tools', where in my experience the bigger disagreement often lies in whether a person accepts that probabilities can be subjective or not; And yes - this does matter.

1Punoxysm11y

Can you please give an example of where the possible subjectivity of probabilities matter? I mean this in earnest.

0Tenoke11y

'From my point of view the probability for X is Y, but from his point of view at the time it would've been Z'. (subjective) vs 'The Probability for X is Y' ('objective'). Honestly though, frequentists use subjective probabilities all the time and you can argue that frequentism is just as subjective as bayesinism, so even that disagreement is quite muddy.

2Punoxysm11y

Can you be more concrete? When would this matter for two people trying to share a model and make predictions of future events?

0Eugine_Nier11y

Part of it is that Bayesianism claims to be not just a better statistical tool, but a new and better epistemology, a replacement and improvement over Aristotelian logic.

0ChristianKl11y

There are a bunch of issues involved. It hard to speak about them because the term Bayesianism is encompasses a wide array of ideas and everytime it's used it might refer to a different subset of that cluster of ideas. Part of LW is that it's a place to discuss how an AGI could be structured. As such we care about the philosophic level of how you come to know that something is true. As such there an interest into going as basic as possible when looking at epistemology. There are issues about objective knowledge versus "subjective" Bayesian priors that are worth thinking about. We live at a time where up to 70% of scientific research can't be replicated. Frequentism might not be to blame for all of that, but it does play it's part. There are issues such an the Bem paper about porno-precognition where frequentist techniques did suggest that porno-precognition is real but analysing Bems data with Bayesian methods suggested it's not. There are further issues that a lot of additional assumptions are loaded into the word Bayesianism if you use that word on LessWrong. What Bayesianism taught me speaks about a bunch of issues that only have indirectly something to do with Bayesian tools vs. Frequentist tools. Let's say I want to decide how much salt I should eat. I do follow the consensus that salt is bad and therefore have some prior that salt is bad. Then a new study comes along and says that low salt diets are unhealthy. If I want to make good decisions I have to ask: How much should I update? There no good formal way for making such decisions. We lack a good framework for doing this. Bayes rule is the answer to that problem that provides the promise of a solution. The solution to wait a few years and then read a meta review is unsatisfying. In the absence of a formal way to do the reasoning, many people do use informal ways of updating towards new evidence. Cognitive bias research suggest that the average person isn't good at this. That sentence is quite easy to s

[-]IlyaShpitser11y100

Full disclosure: I have papers using B (on structure learning using BIC, which is an approximation to a posterior of a graphical model), and using F (on estimation of causal effects). I have no horse in this race.

Bayes rule is the answer to that problem that provides the promise of a solution.

See, this is precisely the kind of stuff that makes me shudder, that regularly appears on LW, in an endless stream. While Scott Alexander is busy bible thumping data analysts on his blog, people here say stuff like this.

Bayes rule doesn't provide shit. Bayes rule just says that p(A | B) p(B) = p(B | A) p(A).

Here's what you actually need to make use of info in this study:

(a) Read the study.

(b) See if they are actually making a causal claim.

(d) Experimental? Do we believe the setup? Are we in a similar cohort? What about experimental design issues? Observational? Do they know what they are doing, re: causality-from-observational-data? Is their model that permits this airtight (usually it is not, see Scott's post on "adjusting for confounders". Generally to really believe that adjusting for confounders is reason... (read more)

0ChristianKl11y

You might want to read a bit more precisely. I did choose my words when I said "promise of a solution" instead of "a solution". In particular MetaMed speaks about wanting to produce a system of Bayesian analysis of medical papers. (Bayesian mathematical assessment of diagnosis) You miss the point. When it comes to interviewing candidates for job then we found out that unstructured human assessment doesn't happen that good. It could very well be that the standard unstructured way of reading papers is not optimal and that we should have Bayesian beliefs nets in which we plug numbers such as whether the experiment is experimental or observational. Whether MetaMed or someone else succeeds at that task and provides a good improvement on the status quo isn't certain but there are ideas to explore. Is it clear that MetaMed as group of self professed Bayesians provide a useful service? Maybe, maybe not. On the other hand the philosophy on which MetaMed operates is not the standard philosophy on which the medical establishment operates.

2IlyaShpitser11y

I don't know how Metamed works (and it's sort of their secret sauce, so they probably will not tell us without an NDA). I am guessing it is some combination of doing (a) through (e) above for someone who cannot do it themselves, and possibly some B stats. Which seems like a perfectly sensible business model to me! I don't think the secret sauce is in the B stats part of what they are doing, though. If we had a hypothetical company called "Freqmed" that also humanwaved (a) through (e), and then used F stats I doubt they would get non-sensible answers. It's about being sensible, not your identity as a statistician. ---------------------------------------- I can be F with Bayes nets. Bayes nets are just a conditional independence model. ---------------------------------------- I don't know how successful Metamed will be, but I honestly wish them the best of luck. I certainly think there is a lot of crazy out there in data analysis, and it's a noble thing to try to make money off of making things more sensible. ---------------------------------------- The thing is, I don't know about a lot of the things that get talked about on LW. I do know about B and F a little bit, and about causality a little bit. And a huge chunk of stuff people say is just plain wrong. So I tell them it's wrong, but they keep going and don't change what they say at all. So how should I update -- that folks on this rationalist community generally don't know what they are talking about and refuse to change? It's like wikipedia -- the first sentence in the article on confounders is wrong on wikipedia (there is a very simple 3 node example that violates that definition). The talk page on Bayesian networks is a multi-year tale of woe and ignorance. I once got into an edit war with a resident bridge troll for that article, and eventually gave up and left, because he had more time. What does that tell me about wikipedia?

2ChristianKl11y

But we don't. MetaMed did come out of a certain kind of thinking. The project had a motivation. Just because you know what the people in the statistic community mean when they say "Bayesian" doesn't automatically mean that you know what someone on LW means when he says Bayesian. If you look at the "What Bayesianism taught me", there a person who changed their beliefs through learning about Bayesianism. Do the points he makes have something to do with Frequentism vs. Bayesianism? Not directly. On the other hand he did change major beliefs about he thinks about how the world and epistemology. That means that the term Bayesianism as used in that article isn't completely empty. Sensiblism might be a fun name for a philosophy. On the first LW meetup where I attended one of the participants had a scooter. My first question was about his traveling speed and how much time he effectively wins by using it. On that question he gave a normal answer. My second question was over the accident rate of scooters. He replied something along the lines: "I really don't know, I should research the issue more in depth and get the numbers." That not the kind of answer normal people give when faced with the question for safety of the mode of travel. You could say he's simply sensible while 99% of the population that out there that would answer the question differently isn't. On the other hand it's quite difficult to explain to those 99% that they aren't sensible. If you prod them a bit they might admit that knowing accident risks is useful for making a decision about one's mode of travel but they don't update on a deep level. Then people like you come and say: "Well of course we should be sensible. There no need to point is about explicitly or to give it a fancy name. Being sensible should go without saying." The problem is that in practice it doesn't go without saying and speaking about it is hard. Calling it Bayesianism might be a very confusing way to speak about it but it seems

1IlyaShpitser11y

Counterexamples to a definition (this example is under your definition but is clearly not what we mean by confounder) are easier than a definition. A lot of analytic philosophy is about this. Defining "intuitive terms" is often not as simple as it seems. See, e.g.: http://arxiv.org/abs/1304.0564 If you think you can make a "sensible" edit based on this paper, I will be grateful if you did so! ---------------------------------------- re: the rest of your post, words mean things. B is a technical term. I think if you redefine B as internal jargon for LW you will be incomprehensible to stats/ML people, and you don't want this. Communication across fields is hard enough as it is ("academic coordination problem"), let's not make it harder by not using standard terminology. I am 100% behind this idea (and in general taboo technical terms unless you really know a lot about it).

-8ChristianKl11y

2Lumifer11y

Speaking of, an interesting paper which distinguishes the Fisher approach to testing from the Neyman-Pearson approach and shows how you can unify/match some of that with Bayesian methods.

4lmm11y

It seems to me that there's a bigger risk from Bayesian methods. They're more sensitive to small effect sizes (doing a frequentist meta-analysis you'd count a study that got a p=0.1 result as evidence against, doing a bayesian one it might be evidence for). If the prior isn't swamped then it's important and we don't have good best practices for choosing priors; if the prior is swamped then the bayesianism isn't terribly relevant. And simply having more statistical tools available and giving researchers more choices makes it easier for bias to creep in. Bayes' theorem is true (duh) and I'd accept that there are situations where bayesian analysis is more effective than frequentist, but I think it would do more harm than good in formal science.

4gwern11y

Why would you do that? If I got a p=0.1 result doing a meta-analysis, I wouldn't be surprised at all since things like random-effects means it takes a lot of data to turn in a positive result at the arbitrary threshold of 0.05. And as it happens, in some areas, an alpha of 0.1 is acceptable: for example, because of the poor power of tests for publication bias, you can find respected people like Ioannides using that particular threshold (I believe I last saw that in his paper on the binomial test for publication bias). If people really acted that way, we'd see odd phenomenon where people saw successive meta-analysts on whether grapes cure cancer: 0.15 that grapes cure cancer (decreases belief grapes cure cancer), 0.10 (decreases), 0.07 (decreases), someone points out that random-effects is inappropriate because studies show very low heterogeneity and the better fixed-effects analysis suddenly reveals that the true p-value is now at 0.05 (everyone's beliefs radically flip as they go from 'grapes have been refuted and are quack alt medicine!' to 'grapes cure cancer! quick, let's apply to the FDA under a fast track'). Instead, we see people acting more like Bayesians... Is that a guess, or a fact based on meta-studies showing that Bayesian-using papers cook the books more than NHST users with p-hacking etc?

0gwern10y

Turns out I am overoptimistic and in some cases people have done just that: interpreted a failure to reject the null (due to insufficient power, despite being evidence for an effect) as disproving the alternative in a series of studies which all point the same way, only changing their minds when an individually big enough study comes out. Hauer says this is exactly what happened with a series of studies on traffic mortalities. (As if driving didn't terrify me enough, now I realize traffic laws and road safety designs are being engineered by vulgarized NHST practitioners who apparently don't know how to patch the paradigm up with emphasis on power or meta-analysis.)

0Douglas_Knight11y

No. The most basic version of meta-analysis is, roughly, that if you have two p=0.1 studies, the combined conclusion is p=0.01.

0Punoxysm11y

To all your points about the overloading of "Bayesian", fair enough. I guess I just don't see why that overloading is necessary. Sure Bayes rule provides a formalization of updating beliefs based on evidence, but you can still be dead wrong. In particular, setting a prior on any given issue isn't enough. You have to be prepared to update for evidence of the form "I am really bad at setting priors". And really, priors are just a (possibly arbitrary) way of digesting existing evidence. Sometimes they can be very useful (avoiding privileging the hypothesis) but sometimes they are quite arbitrary. According to the Slate Star Codex article Bem's results stand up to bayesian analysis quite well (that is, it has a strong Bayes factor). The only exception he mentioned was "I begin with a very low prior for psi phenomena, and a higher prior for the individual experiments and meta-analysis being subtly corrupt"; but there's nothing especially helpful about this in actually fixing the experimental design and meta-analysis. How you get from AGI to epistemology eludes me. As long as the AGI can accurately model its interactions with the environment, that's really all it needs (or can hope) to do. One of them is more useful for prediction and inference. They can guide you towards observing mechanisms useful for future hypothesis generation. That's all you can hope for. Especially in the case of "are low-salt diets healthy". A "Yes" or "No" to that question will never be truthful, because "health" and "for what segments of the population" and "in conjunction with what other lifestyle factors" are left underspecified. And you'll never get rid of the kernel of doubt that the low-sodium lobby has been the silent force behind all the anti-salt research this whole time. The best you can do is provide enough evidence that anyone who points out your hypothesis is not truth can be reasonably called a pedant or conspiracy theorist, but not 100% guaranteed wrong. As you might see, I a

-1Emile11y

Can you point to examples of these "holy wars"? I haven't encountered something I'd describe like that, so I don't know if we've been seeing different things, or just interpreting it differently. To me it looks like a tension between a method that's theoretically better but not well-established, and a method that is not ideal but more widely understood so more convenient - a bit like the tension between the metric and imperial systems, or between flash and html5.

6sixes_and_sevens11y

The term "holy war" or "religious war" is often used to describe debates where people advocate for a side with an intensity disproportionate to the stakes, (e.g. the proper pronunciation of "gif", vi vs. emacs, surrogate vs. natural primary keys in the RDBM). That's how I read the OP, and it's fitting in context.

0Emile11y

Sure, I'm just not sure which debates he's referring to ... is it on LessWrong? Elsewhere?

4IlyaShpitser11y

---------------------------------------- ---------------------------------------- [etc.] Ugh. Here is a good heuristic: "Not in stats or machine learning? Stop talking about this."

1Emile11y

Dude, I'm being genuinely curious about what "holy wars" he's talking about. So far I got: * a definition of "holy war" in this context * a snotty "shut up, only statisticians are allowed to talk about this topic" ... but zero actual answers, so I can't even tell if he's talking about some stupid overblown bullshit, or if he's just exaggerating what is actually a pretty low-key difference in opinion.

[-]VincentYu11y100

A "holy war" between Bayesians and frequentists exists in the modern academic literature for statistics, machine learning, econometrics, and philosophy (this is a non-exhaustive list).

Bradley Efron, who is arguably the most accomplished statistician alive, wrote the following in a commentary for Science in 2013 [1]:

The term "controversial theorem" sounds like an oxymoron, but Bayes' theorem has played this part for two-and-a-half centuries. Twice it has soared to scientific celebrity, twice it has crashed, and it is currently enjoying another boom. The theorem itself is a landmark of logical reasoning and the first serious triumph of statistical inference, yet is still treated with suspicion by most statisticians. There are reasons to believe in the staying power of its current popularity, but also some signs of trouble ahead.
[...]
Bayes' 1763 paper was an impeccable exercise in probability theory. The trouble and the subsequent busts came from overenthusiastic application of the theorem in the absence of genuine prior information, with Pierre-Simon Laplace as a prime violator. Suppose that in the twins example we lacked the prior knowledge that one-third of tw

... (read more)

0ChristianKl11y

Ilya responded to your second paragraph not the first one. metric vs. imperial or flash vs. html5 are not good analogies.

0Jayson_Virissimo11y

For lots of "holy war" anecdotes, see The Theory That Would Not Die by Sharon Bertsch McGrayne. Do you consider personal insults, accusations of fraud, or splitting academic departments along party lines to be "a pretty low-key difference in opinion"? If so, then it is "overblown bullshit," otherwise it isn't.

2satt11y

Various bits of Jaynes's "Confidence intervals vs Bayesian intervals" seem holy war-ish to me. Perhaps the juiciest bit (from pages 197-198, or pages 23-24 of the PDF):

[-]Shmi11y110

The Amanda Knox prosecution saga continues: if the original motive does not hold, deny the need for a motive.

[-]Gunnar_Zarncke11y100

During our Hamburg Meetup we discussed selection pressure on humans. We agreed that there is almost none on mutations affecting health in general due to medicine. But we agreed that there is tremendous pressure on contraception. We identified four ways evolution works around contraception. We discussed what effects this could have on the future of society. The movie Idiocracy was mentioned. This could be a long term (a few generations) existential risk.

The four ways evolution works around contraception:

Biological factors. Examples are hormones compensating the contraception effects of the pill or allergies against condoms. These are easily recognized, measured and countered by the much faster operating pharma industry. There are also little ethical issues with this.
Subconscious mental factors. Factors mostly leading to non- or mis-use of contraception. Examples are carelessness, impulsiveness, fear, and insufficient understanding of the contraceptives usage. These are what some fear leads to collective stultification. There are ethical injunctions to 'cure' these factors even if medically/therapeutically possible.
Conscious mental factors. Factors leading to explicit family pl

... (read more)

[-]Metus11y110

Group selection factors. These are factors favoring groups which collectively have more children. The genetic effects are likely weak here but the memetic effects are strong. A culture with social norms against contraception or for large families are likely to out-birth other groups.

These will by far be the strongest. See for example the birth rates of religious people versus anyone else.

-4Izeinwinter11y

These discussions all have the same problem. They misapprehend how slow evolution is. - Long before any such selection can take place, the human genome is going to get rewritten end to end by deliberate technological intervention. Or heck, people will just stop dying - universal survival means no selection. This means that the only thing that matters for the persistence of any human trait is how much they are valued. Uhm. Including how much they are valued by already-modified humans. A few rounds of iteration on that theme and I can guarantee at least one thing about future humanity: They will be one hundred percent satisfied with their physical incarnation. (because otherwise, it'd get changed.) Think it through. How long do you think it will take before we master genetic engineering and decide to use it? 50 years? 500? 5000? Because at datum 5000, evolution will have done bugger-all to the genome. I mean, lactose tolerance might be a bit more common... but overall? Tech is fast. Social and legal change is slower, but compared to evolution? Blindingly fast. And this is some weak-sauce selective pressures. Most people do have kids. Failing at contraception does not shift the lifetime number of children reliably upwards, it just fucks you over economically. And kids are expensive.

3bramflakes11y

Small changes to genotype don't imply small changes to phenotype.

1Gunnar_Zarncke11y

Evolution is slow. It takes generations. Depending on the selection pressure these may be quite few. Assume sexual drive were the only determining factor for reproductive fitness (which probably is a good approximation for some animals) and you introduce a 95% successful 'contraception' (e.g. a genetic modification to avoid reproduction - this has been done for mosquitoes) and guess how many generations it takes to work around it. Now humans use 95% reliable contraceptives - but their usage is regulated by complex processes so no simple analysis suffices (just think of the misinterpretaion of the baby-bust/pill-gap). Additionally we don't have to limit us to genetic evolution. We could also consider memetic evolution - the one invoked somewhat imprecisely in point 4. Memes evolve faster. It could happen that meme-complexes joining birth-control and anti-science out-breed progress within few generations. Sure after 500 years we'd likely have the technological means - if anyone is still interested in technology then. And for some 500 may be a more likely date than 50.

-3Izeinwinter11y

It takes many generations. Human generations are quite long. Without a technological civilization, the oldtime pressures of hunger and violence will dominate everything else - Which in some ways favors various means of birth control. Because having 6 kids and having all of them die due to splitting available resources to many ways is not a successful strategy. Therefore, your projection only makes sense in a continuing technological civilization, in which case engineering happens. And again. Most people have kids. Successful use of birth control allows you to control time and number of said kids, the mosquito analogy holds no water whatsoever, if you want to model the selective advantages / disadvantages of this, you are going to need extensive real world data over generations- and a computing model projecting forward, and you would still be making stuff up.

0Gunnar_Zarncke11y

Agreed. But the speed of technology is estimated quite variably. And at least currently there are already ethical (read: memetic) constraints on applying technology to reproduction. So one could argue that the selection pressure is already doing its work. Agreed. What do you propose? Assuming it too complicate to contemplate?

-1Izeinwinter11y

.... Yes. I mean, if you want to do a phd's worth of work, there are existing datasets one could mine - but the time horizon (since the legalization of birth control) is so short and the social context regarding reproduction has been shifting so heavily during this period that any predictions you make would end up being barely guesses. Fortunately, the subset of plausible futures in which this matters is absurdly small. The world would essentially have to enter into technological and social stasis for many thousands of years, and well. Uhm. No. The marching morons has a lot to answer for, really, since variations on this is an idea that crops up like weed, and it is a pretty absurd scenario.

0Gunnar_Zarncke11y

This is kind of an relevant argument because it means this - despite my non-political phrasing - is really a political topic because the opinion coalition effects are possibly much stronger than any solid predictions to be had. Or to rephrase this: Any actual biological effect is outweight by memetic effects. I beg to differ.

[-]cousin_it11y90

When I'm procrastinating on a project by working on another, sexier project, it feels exactly like a love triangle where all three participants are inside my head, with all the same pleading, promises and infidelities. I wish that told us something new about procrastination or love!

[-]NancyLebovitz11y80

A statistical look at whether bike helmets make sense-- concludes that there are some strong arguments against requiring bike helmets, and that drivers give less room to cyclists wearing helmets.

[-]Tenoke11y80

I am repeating myself so much, but..

Why is this posted a day early (when the prior thread was posted earlier than it should've been solely so they can start on Monday).? And way more impotantly, why is the open_thread tag not there. Can you please at least include it (it is important for the sidebar functionality, among other things).

I often rant about people posting the open threads incorrectly when there is so little about it (posting it after the previous one is over, making it last 7 days and adding a simple tag), but this is the 3rd OT posted this wee... (read more)

3Robin_Hartell11y

How much appetite would there be for shorter windows on the Open Threads? Having one every 4 days would have some advantages: * The material would be spread out more evenly through time, rather than having the majority of the posts in the first few days of a new thread * The start day would vary over time

2Tenoke11y

I am not sure if you are aware, but the OTs have been a monthly rather than weekly event for years until a few months ago. At any rate, I am generally not convinced that a further reduction is needed, as it will 1. It might make people even more confused as to when to post them 2. It is generally becomes more 'spammy 'and 3. The benefits of a further reduction are questionable.

1pinyaka11y

I created one of the other incorrect OT threads because the post date of the correct one didn't match the expiration date of the previous one (so quickly eyeballing posts at that date in the Discussion post list didn't turn it up) and searching via the box for "Open Thread" didn't return the current one in the first page of results (although it did turn up the previous one almost at the top of the list). I didn't use the tag because I didn't know that I was supposed to. There isn't really an obvious set of rules or standards for creating open threads, so I did what it seemed like other people do and just created one when it looked like there wasn't a current one, copying the text from the previous one for the body and choosing the seven day range following the previous OT thread (hence the title saying 23 April, even though I posted on the 24th). I notice now that the latest open thread is on the sidebar. I looked for that specifically and didn't see one, so that will help people who go through the same process as me. (ETA: I notice that it's not on the sidebar from every page. This is what the sidebar currently looks like from my profile and does not include a link to the current OT. It would not have occurred to me to look at the sidebar from multiple pages. Same goes for the current Rationality Diary, and for some reason the latest Rationality Quotes is only on the sidebar on my profile page, not the discussion list or in this thread) If you're really concerned about starting on Monday and using the tag, perhaps adding a set of instructions on creating new OT posts in the body of the OT post for people to copy and paste will be helpful. Final Edit: The search result page sidebar also does not include the latest OT or rationality diary and that is likely the page whose sidebar I would have checked.

0Metus11y

People want to say something and think that it will drown out in the previous open thread. So they do their own.

2Tenoke11y

This does not explain the current thread, as Nancy did not post anything in it initially (but seems to be a big part of it).

[-]NancyLebovitz11y70

Why engineering hours should not be viewed as fungible-- increasing speed/preventing bottlenecks is important enough to be worth investing in. An example of how to be utilitarian without being stupid about it.

Any recommendations for discussions of how to figure out what's important to measure?

[-]David_Gerard11y60

HELP WANTED: I recall that it is highly questionable that consciousness is even continuous. We feel like it is, but (as you know) we have considerable experimental evidence that your "consciousness" thinks things well after you've decided to do them. I can't find it, but I recall a result that says that "consciousness" is a story your brain tells itself after-the-fact, in bursts between gaps of obliviousness. (This also dissolves "quantum immortality".) Does anyone know about this one?

5Risto_Saarelma11y

Don't remember an exact result like that, but that did remind me of Denntt's Consciousness Explained, which had stuff about the brain doing all sorts of after-the-fact rewriting of sensory inputs to create a single narrative that presents itself as the conscious experience.

2David_Gerard11y

That's probably what I'm thinking of. Thank you to you and bramflakes!

4bramflakes11y

I think Dennet talks about it a lot, possibly in Consciousness Explained, but I don't know whether those experiments had been done in 1991.

[-]niceguyanon11y60

The 135 degree angle sitting position seems popular these days but sometimes the chair you are sitting in can not recline.

So if you must sit in a non-reclining chair, is it better to sit upright on the edge of your seat with your knees bent at 45 degrees and maintain a hip angle of 135 degrees or to sit in a relaxed upright position using the back support at a relatively 90 degree hip angle?

0tut11y

It is better to sit with your entire back against the backrest. What angle to set the backrest to is a second order optimization, the ideal angle is not the same for everyone, and it if you sit for more than an hour at a time it is better to change the angle now and then than to leave it at any given angle.

[-]Suryc1111y60

This is a really great take on why use of privilege-based critique in (often leftist) public discourse is flawed:

http://harvardpolitics.com/united-states/privilege-leftist-critique-left/?fb_action_ids=10152177872632732&fb_action_types=og.likes

(Tl;dr: it's both malicious, because it resorts to using essential features of interlocutors against them--ie, quasi-ad hominems--and fallacious, because it fails to explain why the un(der)-privileged can offer arguments that work against their own interests.)

6V_V11y

I'd always thought that using 'privilege' arguments was the plain and simple ad hominem fallacy.

[-]NancyLebovitz11y160

To the extent that privilege claims are about ignorance, I think they're likely to have a point. To the extent that they're a claim that some people are guaranteed to be wrong, they're ad hominem.

[-]fubarobfusco11y140

One really common case is when person A says something to the effect of, "I don't see why B people don't do X instead of complaining about fooism" — but X is an action that is (relatively easily) available to person A, but is systematically unavailable to B people. (And sometimes because of fooism.)

Or, X has been tried repeatedly in the history of B people, and has failed; but A doesn't know that history.

Or, X is just ridiculously expensive (in money/time/energy) and B people are poor/busy/tired, or otherwise ill-placed to implement it.

Or, X is an attempt to solve the wrong problem, but A doesn't have the practical experience to distinguish the actual problem from the situation at hand — A may be pattern-matching a situation into the wrong category.

Some of this post could totally be rephrased as being about "non-depressed-person privilege", but the author doesn't write like that.

1V_V11y

Then the correct response is to point out that X is hard/impractical/ineffective, supporting your point with evidence or plausible arguments. Asserting to know better because of your incommunicable personal experience, quite possibly affected by confirmation bias and whatnot, is not a way of arguing, it is a way of refusing to engage in intellectual discussion.

3Viliam_Bur11y

I can imagine people frustrated from having to explain the same concept online for the hundredth time; always to someone else; often to people who genuinely don't know, but sometimes to trolls. That's the moment where people are likely to point to a FAQ. That's why we have the Sequences here. Etc. The problem is that the FAQ (or the Sequences) usually do contain the full explanation, and sometimes even a place where that specific explanation can be debated. But the sentence "check your privilege" does not. It is not replacing hundreds of explanations with one, but hundreds of explanations with zero. (Sure, I could google what "privilege" means, but then I'd get dozens of explanations, sometimes mutually contradictory. And I don't know which of the versions the person had in mind. Or it can say that privilege means X or Y or Z, and it may seem to me that neither applies to what I have said, and I don't know which one of them was supposed to apply to me. -- As a loose analogy, it is better to link people to a specific article in the Sequences, than to Sequences as a whole.) I guess the solution would be to write a good "Privilege FAQ". One written by a rational person, which would explain ways how to use it but also how to not use it, encourage people to link to specific subsections of it, and perhaps contain a short commentary to the most frustratingly repeated specific misunderstandings. (Problem is, creating a good FAQ is hard work, and it may not be the same fun as bullying random people online. -- This applies to internet debates in general, not just specifically about privilege.)

3V_V11y

Of course it is quite possible that people from certain backgrounds may tend to be ignorant about certain facts, but then when they say something factually incorrect in a public discussion, the correct answer is to just correct their errors with evidence and plausible arguments. Saying "you are privileged" at best adds no information and sets a hostile tone, at worst, if you can't support your point with communicable evidence or plausible arguments, is an ad hominem.

5NancyLebovitz11y

As I understand it, a problem the privilege model is designed to address is people who ignorant about important difficulties, and are unwilling to listen. "Privilege" raises the temperature enough to get some people to bend. Of course, psycho-chemistry being what it is, it gets other people to become more rigid, to melt down, or to explode.

2Eugine_Nier11y

In a way that has no reason to correlate with the truth of the issue under discussion.

0NancyLebovitz11y

None of the typical reactions to "privilege" are reliably related to the truth of the matter.

0taelor11y

That's another problem with overuse of the "priviledge" concept: the more people throw it around, the less punch it packs.

0Suryc1111y

Agreed, that's a great way of putting it.

1David_Gerard11y

There's the difference between logical fallacy and Bayesian fallacy. Most logical fallacies got evolved into human thinking because they often enough in fact constituted Bayesian evidence. e.g. authorities on a subject often know what the hell they're talking about.

-4V_V11y

Sure, many informal fallacies derive from useful heuristics. The problem is occurs when these heuristics are used as hard rules, especially when dismissing criticism. For instance, the typical 'privilege' argument is: "You are white/male/heterosexual/cisgender/educated/upper class/attractive/fit/neurotypical, therefore your arguments about non-white/female/gay/transgender/uneducated/working class/unattractive/fat/neuroatypical people are wrong." It is reasonable that people with certain life experiences may have difficulties understanding the issues of people with different life experiences, but this doesn't mean that you need to share life experiences in order to make an informed argument. The "therefore you are wrong" part of the privilege rebuttal is a fallacy.

5Eugine_Nier11y

Notice that this steelmanning of 'privilege' is completely symmetrical, i.e., an "unprivileged" person would have the same problems with respect to the "privileged" person as conversely. Given that this "steelman" has no connection to the common use of the word "privilege" the question arises, of why that word is being used at all? The answer, I suspect, is in order to sneak in the connotations from the regular meaning of the word "privilege".

2NancyLebovitz11y

The more power you have, the more damage you can do through ignorance.

1Eugine_Nier11y

Do you mean individual or collective power? Individually the average poor citizen may not have much power, but collectively they can do stupid things like voting for the candidate promising to "make the rich pay their 'fair share' ".

0NancyLebovitz11y

I think the privilege model is neither completely true nor completely false, and one of the ways it falls down is that it's framed as absolute about members of groups (and according to a static list) rather than being about a statistical tilt.

-1Eugine_Nier11y

The problem is as I mentioned, to the extend it is true, it doesn't correspond to the connotations of the word "privilege".

0pragmatist11y

The argument against symmetry is that the privileged perspective is massively over-represented in prominent cultural productions (movies, books, op-eds, etc.), so underprivileged people have many more resources available that allow them some access to the experiences of the privileged. See this, for instance.

-1Eugine_Nier11y

Really? What definition of "privilege" are you using here? I agree that certain perspectives are over-represented in cultural products, but those are not the same ones that the SJ-types call "privileged".

0NancyLebovitz11y

If the argument is about how the world of people (as distinct from scientific conclusions) works, then life experiences are important information. What sort of argument about the world (say, an argument about why people are poor) should ignore life experience? Admittedly, the experiences of two people aren't enough, but at least that's a start. It's also worth checking on whether one of the people is arguing from no experience.

0David_Gerard11y

Indeed, "therefore you are wrong" does not follow logically. The usage I more often see is "please, you're being a dick, stop it."

0V_V11y

Which is even worse because it accuses the other party of bad faith. Clearly, that's a conversation stopper.

0ChristianKl11y

Does the article say anything that shouldn't already be obvious to the average LW reader and is therefore worth reading?

3IlyaShpitser11y

It says: "don't hate the player, hate the game."

3NancyLebovitz11y

I'm not sure what the average LW reader knows. I consider it likely that there are LW readers (both left and right) who don't know there's opposition to the privilege model from the left.

1ChristianKl11y

I think the idea that shooting people down based on perceived privilege is an ad hominem is fairly straightforward and obvious.

2Viliam_Bur11y

Well, it's still encouraging to get a feedback that the public sanity waterline is higher than absolute zero. Nothing is "straightforward and obvious" for everyone. Especially when it's somehow related to politics.

0NancyLebovitz11y

I don't think "malicious" quite does the delicacy of that sort of very abstract Marxist argument justice, though I'm not sure what word would be better. "Unfair" doesn't quite do the job, either, though the author does point out that a privilege framework means that the same argument will be approved or ignored depending on who makes it. "Consciousness itself is complicit." is kind of cool. It could almost be something from LW (or at least Peter Watts), but the author probably means something else by consciousness.

2Suryc1111y

I agree, though to be fair the author himself seems to use malicious and fallacious to describe a privilege framework. ...

[-]NancyLebovitz11y60

Man becomes mathematical savant after brain injury

Podcast interview

[-]Aussiekas11y50

Ok, my utility is probably low considering this open thread closes in 3 days :(

Anyhow, I had a thought when reading the Beautiful Probabilities in the Sequences. http://lesswrong.com/lw/mt/beautiful_probability/

It is a bit beyond my access and resources, but I'd love to see a graph/chart showing the percentage of scientific studies which become invalid or the percent which remain valid as we reduce the p <0.05.

So it would start with 100% of journal articles (take a sampling from the top 3 journals across various disciplines then break them down betwee... (read more)

[-]fubarobfusco11y50

Poll: Consequentialism and the motive for holding true beliefs

1. Is an action's moral status (rightness or wrongness) dictated solely by its consequences? [pollid:685]

(For calibration — I would expect people who identify strongly as consequentialists to answer "strong yes" on question 1, while people who identify strongly as deontologists to answer "strong no", while people who are somewhere in between would choose one of the middle buttons based on how they lean.)

2. Is the truth value (truth or falsity) of a belief about the world ... (read more)

8Alejandro111y

In question 1, is "consequences" supposed to mean "actual consequences", "expected consequences", "foreseeable consequences"…?

1fubarobfusco11y

Any of the above.

[-]mare-of-night11y40

As someone who uses more water than most people, would it be irresponsible for me to move to a dry climate?

I realized that I've been entirely leaving the southwest United States off of my list of options for where to live after I graduate college, because I'd decided when I was much younger that I shouldn't live in the desert. Now, I'm realizing that I have very little idea how important that is compared to other concerns. I'm not sure how to go about weighing the utility of an additional person using too much water in the desert.

I probably use 2-3 times m... (read more)

4lmm11y

This is the kind of thing where economic measures are useful. For political reasons you may not get a true cost for residential water, but maybe see how much industries in that area are paying per litre? Then you can calculate the dollar value you'd be imposing by living there, and compare it with the value you put on other differences between the places you're choosing from.

0mare-of-night11y

I see how that would work. Thanks.

3[anonymous]11y

I doubt that using 2-3 times more water would end up being the dominant factor in whether you should move. What other factors exist that you're considering? Is there a possibility of making more money in the dry climate?

2mare-of-night11y

That was pretty much my intuition too, once I actually thought about it. For context, this is on my mind because I'm graduating from college in a year. I'm still figuring out my values and their relative importances. (I'm going to make a post about it later, if I'm still unsure after talking it over with myself and my friends.) I've heard that the Southwest has a lower cost of living than the rest of the country, and some areas have nice weather, but beyond that I don't know a whole lot about what it's like living there. (I'm on study abroad in Sydney now, and noticing that I go outside more when in an interesting neighborhood with nice weather.) At the moment, all the cities near the top of my mental list are in the northeast US. I'm pretty sure that's at least partly because that's the only region I've stayed in for more than a couple weeks at a time, and I'm slightly homesick at the moment. Probably what I should do is do a bit of research now and write down what I'm thinking, and then come back to it once I've come back to my hometown and had some time to get bored of it, and maybe again during my last semester of college. It's probably not worth trying to evaluate places out of driving distance of Pennsylvania until I stop being homesick, now that I think of it that way.

0[anonymous]11y

Welcome to the club.

[-][anonymous]11y40

this piece is about whether earning to give is the best way to be altruistic.

but I think a big issue is what altruism is. do most people mostly agree on what's altruistic or good? have effective altruists tried to determine what real people or organizations want?

you don't want to push "altruism given hidden assumptions X, Y and Z that most people don't agree with." for example, in Ben Kuhn's critique he talks about a principle of egalitarianism. But I don't think most people think of "altruism" as something that applies equally to the ... (read more)

5David_Gerard11y

I do find it disconcerting just how little I see EA talk about changing society. The charity sector's budget in any given country is ridiculously smaller than the government budget; EA advocates talk about directed giving as the best way to change the world, but this appears to me to be deliberately ignoring systemic problems in favour of enshrining personal charity as a substitute for government. "When I give food to the poor, they call me a saint. When I ask why they are poor, they call me a communist." (Hélder Câmara) (I realise Singer's original ideas are all about systemic change.)

4NancyLebovitz11y

EA is about things that are relatively easy to measure, and causing political change is hard to measure.

2fubarobfusco11y

Some policy changes are hard to measure. Some are controversial to measure — you can measure them, but people will call you nasty names for doing so. I expect that anyone who measured and forecast the health effects of reduction in lead pollution, back in the days of lead paint and leaded gasoline, was probably called "anti-business" or worse. Fortunately, they won anyway, and the effects are indeed measurable — in reduced cases of lead poisoning, and apparently in increased IQs of city residents.

0jpl6811y

I do not think EA is about things that are relatively easy to measure. It is about doing things with the highest expected value. It is just that due partly to regression to the mean things with measurably high values should have among the highest expected values. See Adam Caseys posts on 80 000 Hours.

0David_Gerard11y

Goodhart, of course: after a short time, only the metric counts. The solution is obvious: I create enough simulations that are good enough to constitute sentient beings, and make them all happy, that this adds up to MUCH more goodness than my present day job running a highly profitable baby mulching operation to fund it all. Like buying "asshole offsets".

2ChristianKl11y

The Swiss EA people did try to get a referenda passed. They engage with the political system. Getting university cafeterias to be vegan is a political agenda. It's just not the classic political agenda that you find in the mainstream political debate. 21st century politics is strange. The story that TV news media tells is still so strong that young people seem to think that politics is about fighting the battles of their parents instead of fighting their own battles. That's no effective catch phrase. You know, EAs actually care about effectiveness ;) This is kind of funny. At the Community Weekend in Berlin Jonas spoke about EA movement building and how one should use the label that most effective for a community. Calling it Effective Altruism is a PR move. I think that largely depends on your skill set. The core political goal should be to get decent people into positions of political power. Maybe some of the people who do today EA movement building also build the kind of skills in the process that they need to run political campaigns in 10 years. Of course at that point they need other EAs to fund their campaigns (at least in the US).

2[anonymous]11y

The Swiss folks may have done that. But I think the major organizations, like GiveWell, Giving What We Can, and 80,000 Hours, are focused on apolitical causes like global health, if you judge from their lists of recommended charities. Also I don't think there's any getting around taking a position on mainstream political issues to optimally benefit society. Statistically your income is more influenced by which society you happen to be born in than anything you do. If you believe Acemoglu and Robinson, it's the institutions that matter for economic growth. Huh? It might. (Thank you for giving a data point.) I find myself drawn toward the earning to give route since then you can use your salary to kinda measure impact. You could measure too with seeking political office although that's not my cup of tea. But with political activism I don't really see how.

1ChristianKl11y

I don't think 80,000 hours advice people who seek it's guidance against going into politics. GiveWell states that they focus on global health issues because those issues provide a good evidence base. I think Giving What We Can says that it's members can make donation to any charity of their choosing. "Should we do liquid democracy?" is an import question when it comes to designing institutions. It's not a question that left or right in the traditional sense of those words. In software design a lot of thought went into structuring information and valuing simplicity. Getting that kind of thinking into law making would do a lot of good but it's no mainstream topic. Opposing corn subsidies isn't a right or left issue. Especially if you do it on the ground that the subsidies make meat too cheap and you want people to eat less meat. Fighting software patents and patents trolls isn't a right vs. left issue. Whether or not you have legal responsibility when you route traffic of other people over your own computer isn't a right vs. left issue. Pushing evidence-based policy making isn't a right vs. left issue. Ben Goldacre's fight to get trial data out in the open is highly political in nature. You could label it "socialism" to force big pharma to release their knowledge into the commons but I think that heavily screws with the nature of the conflict. I think that even people who see themselves politically on the right are likely to support Goldacres agenda. What do you mean with "political activism". The term is frequently used by people who want to signal that they care about an issue but who aren't willing to actually to something that has political effect. Saul Alinsky would be someone who thought a lot about how to do political activism. It starts with doing community building. In the EA example that means at this point in time most of the activism resources should go towards internal affairs of the EA movement.

0Lumifer11y

Mainstream political issues are often about what does "optimally benefit society" mean.

0ChristianKl11y

I finished that paragraph via editing.

2Jayson_Virissimo11y

That the effects of abortion are economically neutral seems like an extraordinary claim. What kind of evidence did you have in mind? If those anti-abortion people that hang out on campus are right, then roughly 50 million abortions have taken place in America since Roe v. Wade. How could an extra 50 million people have a neutral effect on the economy?

6Shmi11y

Not really. If I recall, legalizing abortion has almost no effect on the birth rate, accessible contraceptives are somewhat higher, but none come close to changing cultural norms. 50 million mostly legal abortions, even if the figure is correct, does not translate to 50 million more adults, of course. It is not even clear whether the overall effect is increase or decrease in population.

5Jayson_Virissimo11y

Well, this is what I found in < 5 minutes of searching: -- Klerman, Jacob Alex. "US abortion policy and fertility." (2000). -- Guldi, Melanie. "Fertility effects of abortion and birth control pill access for minors." Demography 45, no. 4 (2008): 817-827. -- Coates, Brandi, Alejandro Companioni, and Zachary A. Bethune. "The Impact of Abortion Legalization on Birth Rates!." Okay, so a quick search for studies on the effects of abortion legalization on birth rates seems to confirm my priors, so...it still looks like an extraordinary claim. Agreed, I shouldn't have used that number, but according the first couple of studies I came across it definitely would be positive and over 40 years time it seems plausible that even some of those people that would have been born would have had kids by this point.

4Shmi11y

Interesting, thanks. Incidentally, the CDC data show that the abortions/life births ratio is pretty significant, though it's declined from 36% in 1979 to 22% in 2010. This is surprisingly high. I don't know what to make of it. My prior expectation was maybe a percent or two. Every 5th fetus is aborted? Or am I reading the data wrong? Canadian rates seem to be similar, with every 4th fetus being aborted.

1[anonymous]11y

I suggested this division of causes because, first, people who earn to give may join the upper or at least upper middle class. It seems harder to advocate for things like socialism when your peer group is rich. Your opinions aren't going to earn you praise or friends and friends and connections are really important for making money. It's also hard to devote time and energy to maintaining odd views when you're focused on a career that isn't directly involved with acting on those opinions. You're losing some potential synergy. It also possible that, second, the usefulness of cash donations varies with whether the cause has support among the rich or poor, although this might work the other way in that I would expect causes that favor the poor to need money more. But with a topic like abortion this all seems unclear--although opinions on abortion do correlate some with income, I don't think that correlation is a strong as with outright economic redistribution. What do you think? If you want to suggest a more clearly neutral topic than abortion I would be interested to hear it.

2Eugine_Nier11y

Um, there a lot of rich people who at least profess socialist views, the common somewhat dismissive term for them is champagne socialist.

0ChristianKl11y

What do you mean exactly when you say socialism? As far as the numbers on abortion go, for 75k

[-]hamnox11y40

Hi, CFAR alumni here. Reposting I guess, the OTs are getting confusing.

Is there something like a prediction market running somewhere in discussion?

Going mostly off of Gwern's recommendation, it seems like PredictionBook is the go-to place to make and calibrate predictions, but it lacks the "flavour" that the one at CFAR did. CFAR (in 2012, at least) had a market where your scoring was based on how much you updated the previous bet towards the truth. I really enjoyed the interactional nature of it.

What would it take to get such a thread going onli... (read more)

5Viliam_Bur11y

Unfortunately, this would be easy to abuse online. Create a sockpuppet account, make a stupid prediction, and then quickly fix the prediction using your real account. This is equivalent to moving bits from one account to the other. At CFAR workshop all participants were real people. But they still missed an existing opportunity to abuse the system: there were rewards for winning, but no punishment for losing. So two people could agree to transfer a lot of bits from one to another, and split the price afterwards. Maybe a system more difficult to abuse can be designed, but a direct copy of algorithm used at CFAR isn't it.

2palladias11y

Not quite true. I ran the markets, and I did threaten to fearsomely glare at people who were abusing the system. (And my glare is very fearsome).

1hamnox11y

You're right. Gaming the system is feasible, though I believe it is very low-value. What exactly would the point of gaming a prediction thread be? The only point-keeping would be informal, so if you're making a bunch of points off of idiotic puppets bets it's still visible as because you were up against an idiotic bet. It'd be like lying on the group diary, almost. Do note, there was actually a HUGE punishment for losing. You could get into the negative pretty easily by being stupidly overconfident. The scoring was 100 × log2(Your probability of outcome/Previous Bet probability of outcome).. For example: if you updated a 50% house bet to 99% being correct would give you 98.55 "bits", while being wrong would give you -564.39

0philh11y

Only to the extent that you care about points, whereas the winner was given a tangible prize (in my case, a book). Actually, I'm now remembering that that isn't entirely true: there was a prize for the person with most points, but also a prize that was assigned randomly, weighted according to ((player points) - (least number of points of any player) + 1), or something. So the more you lose by, the less chance you have of winning that prize. But if you're near the back anyway, your chance of winning is so small that this is a very small punishment. (I think we might have had someone who was convinced to get many negative points, to reduce the effective spread among everyone else. Or I might be making that up.)

0hamnox11y

Ah, I do not believe there was such a prize system at my minicamp.

0philh11y

I raised this possibility, but an instructor said they'd use human judgment to stop us from doing that. (My actual idea was along the lines of "if two of us decide that we aren't going to come to agreement on a market, we can just repeatedly alternate our bets, and each expect that we're getting arbitrarily many points from this". The instructor said something like, they'd just ignore all but the final bets if they thought we were doing that.)

0witzvo11y

This is interesting. Can someone point me to documentation of the scoring? Thanks. (unless it's a CFAR secret or something)

2hamnox11y

100 × log2(Your probability of outcome/Previous Bet probability of outcome).. For example: if you updated a 50% house bet to 99% being correct would give you 98.55 "bits", while being wrong would give you -564.39 It's posted a couple of posts up. I had given no credence to the idea that it could be a CFAR secret.

[-]sebmathguy11y30

I've just made an enrollment deposit at the University of Illinois at Urbana-Champaign, and I'm wondering if any other rationalists are going, and if so, would they be interested in sharing a dorm?

[-]Oscar_Cunningham11y30

LINK: Someone on math.stackexchange ask if politically incorrect conclusions are more likely to be true by Bayesian Logic. The answer given is pretty solid (and says no).

1philh11y

It assumes that the ratio of true-to-false statements repeated is the same regardless of political correctness. (If a true PC statement is four times more likely to be repeated than a false PC statement, then a true PI statement is four times more likely to be repeated than a false PI statement.) I'm not sure that's true. But this does give us the conditions required to assume a PI statement is more likely to be true than a PC statement, which is valuable.

[-]Risto_Saarelma11y20

Charles Murray has an entertainingly cranky review of Nicholas Wade's upcoming book A Troublesome Inheritance: Genes, Race and Human History up at The Wall Street Journal.

[-]palladias11y20

Career advice? I've been offered a fellowship with the Education Pioneers.

For ten months (starting in Sept), I'd be embedded with a school district, charter, or gov't agency to do statistics and other statistical planning. I need to reply to them by next Friday, and I'd appreciate people pointing out questions they think I should ask/weight in my own decisionmaking. Please take a second to think unprimed, before I share some of my own thoughts below.

I'm currently working for less than minimum wage in a journalism internship that ends June 1. I strong... (read more)

1Shmi11y

What's so good about DC unless you are a politics junkie?

2palladias11y

* It's a reasonably sized city (giving me theatre, foreign films, lectures, etc) * Plus public transportation (I don't know how to drive) * Short trip on Amtrak to see my family in NY * I am a politics junkie * So are a lot of my friends, so the plurality of people I care about most all live here * As a result, I get to do group movie nights, DnD, parliamentary debates, babysitting with them Also, I'd bet the kind of person I ultimately want to marry is most likely to want to live in DC, too.

1Shmi11y

Interesting. I'd imagine that, except for Federal politics, most of these needs would be better served some place like NY, but I see what you mean.

0NancyLebovitz11y

A lot of free museums, too.

0[anonymous]11y

What are your other options? Do you see any negatives to this fellowship?

0palladias11y

Well, I've sent out a lot of (mostly writing) applications, and not gotten bites on anything good. I've been interviewing here and tipped them off I had an offer, and am waiting to hear back. I've done public policy analysis before and could do it again. Definitely have written too much Snowden/Manning coverage to get a security clearanced job in DC, so places like Booz Allen are right out. ;)

[-]raisin11y20

How is the picture of the Sirens and Odyssey tied to a mast in the header of Overcoming Bias related to the concepts talked on the site?

[-]arundelo11y160

Odysseus realized that he couldn't trust his own mind (or those of his sailors) but found a workaround.

To "overcome bias" is to find workarounds for the mind's failure modes.

0satt11y

Along similar lines, Jon Elster was so taken by that literary motif that he used it in his Ulysses and the Sirens: Studies in Rationality and Irrationality, as well as his later Ulysses Unbound: Studies in Rationality, Precommitment, and Constraints.

[-]RolfAndreassen11y20

I suggest that siren worlds should be relabeled "Devil's Courtships", after the creepy song of the same name:

"I'll buy you a pennyworth o' priens If that be the way true love begins If ye'll gang alang wi' me m'dear, if ye'll gang alang wi' me?"
"Ye can hae your pennyworth of priens Though that be the way true love begins For I'll never gang wi' you m'dear, I'll never gang wi' you."
"I'll buy you a braw snuff box Nine times opened, nine times locked If ye'll gang alang wi' me m'dear, if ye'll gang alang wi' me?"
"

... (read more)

[-]Metus11y20

After a contribution to a previous thread I thought some more about what I actually wanted to say, so here is a much more succint version:

The average of any distribution or even worse of a dataset is not a sufficient description without a statement about the distribution.

So often research results are reported as a simple average with a standard deviation. The educated statistician will recognise these two numbers as the first two modes of a distribution. But these two modes completely describe a distribution if it is a normal distribution. Though the centr... (read more)

5gjm11y

I think you mean moments, not modes (here and twice more in the same paragraph). I mention this for the benefit of anyone reading this and googling for more information. I'm guessing you mean "has higher moments matching those of the normal distribution" or something, but I don't see any advantage of this formulation over the simpler "is normally distributed" (or, since you're talking about a dataset rather than the random process that generated it, something like "is drawn from a normal distribution"). Usually, saying something like "such-and-such a distribution has no fourth moment" means something very different (and incompatible with being normal): that its tails are fat enough that the fourth moment is undefined on account of the relevant integral being divergent. There's a deeper connection between means and normality. One of the reasons why you might summarize a random variable by its mean is that the mean minimizes the expected squared error: that is, if you've got a random variable X and you want to choose x so that E[(X-x)^2] is as small as possible, the correct choice for x is E[X], the mean of X. Or, if you have a dataset (x1,...,xn) and you want to choose x so that the mean of (xi-x)^2 is as small as possible, then the correct choice is the mean of the xi. OK, so why would you want to do that particular thing? Well, if your data are independent samples from a normal distribution, then minimizing the mean of (xi-x)^2 is the same thing as maximizing the likelihood (i.e., roughly, the probability of getting those samples rather than some other set of data). (Which is the same thing as maximizing the posterior probability, if you start out with no information about the mean of the distribution.) So for normally distributed data, choosing the mean of your sample gives you the same result as max likelihood. -- But if what you know, e.g., is that your data are drawn from a Cauchy distribution with unknown parameters, then taking the mean of the samples will

5Vladimir_Nesov11y

(The "only if" is incorrect. For many other families of distributions, knowing mean and variance is also sufficient to pinpoint a unique distribution.)

0Metus11y

I must have mixed it up with some other statement.

4sixes_and_sevens11y

"Yeah, sorry I said something that was incorrect. I meant to say something that wasn't incorrect." I've seen more ballsy responses than this, but not many.

0Luke_A_Somers11y

I don't understand. Metus flatly admitted error, end of story.

0sixes_and_sevens11y

For clarity, I found what Metus said to be very funny. I commented because I wanted to underscore the humour, not because I wanted to be critical.

0fezziwig11y

FWIW, I also read it as an insult. And though I do believe you that that wasn't your intent, I don't see how else to read it even now.

3sixes_and_sevens11y

Well, it wasn't intended as a kind comment either, but it clearly fell a lot flatter than I thought it would.

[-]NancyLebovitz11y20

It looks like I made a mistake-- I checked, but somehow failed to see the thread ending on April 27.

I could kill this one, but there's already one legitimate open thread post. I'll go with the consensus on whether to delete it.

[-]philh11y100

It might be worth editing more instructions to submitters into this post. Along the lines of 'If you notice that the previous thread has expired, feel free to post the next one. It should run monday-sunday, and it should include the open_thread tag so that it gets picked up on the sidebar'.

4Oscar_Cunningham11y

Let it live. Just add the "open_thread" tag and maybe change the title so that this one runs to May 4.

0Gunnar_Zarncke11y

it's too late to kill. See it as a reminder (for the time being) to be more careful.

[-][anonymous]11y00

There's been debate on whether earning to give is the best way to be altruistic.

But it seems to me that the real issue is not what is most altruistic but what altruism is. It's not clear to me that most people mostly agree on what's altruistic or good--or even if one person is self-consistent in different contexts. Is there some case for this besides just saying "I have this intuition that most people agree on what's good"? Has there been much attempt by effective altruists to investigate what real people or organizations want?

[This comment is no longer endorsed by its author]Reply

[-]Metus11y-10

"The burden of proof is on you."

No, most of the time the burden of proof is on both parties. In complete absence of any evidence both the statement and its logical negation have equal weight. So if one party states "you can't predict the shape of the bottle the liquid was poured out of from the glass it is in" and the other party states the opposite, the burden of proof lies on both parties to state their respective evidence. Of course in the special case above the disagreement was about the exact meaning of "can" or "can... (read more)

6ChristianKl11y

A burden of proof depends on the context. If you want to convince me to adopt then you have to fulfill a burden of proof and convince me that's a good decision for me to make. If you want simply want to talk about your experience that your new dog is awesome, you don't have to fulfill any burden of proof to me. If a company wants to bring a new drug on the market they have to establish it's clinical benefits in two statistical significant clinical trials. On the other hand adverse effects have a lower burden or proof. You need far less evidence for the FDA to get a company to bring up a certain effect as adverse effect for a drug. Is truth different for benefits then adverse effects? No. But burden of proof is. Burden of proof always depends on the purpose for which you want to use information. If you ask me: What do you believe about topic X? I don't have any burden of proof to prove that my beliefs on X are true. I only have a burden once I want you to change your belief.

5Vladimir_Nesov11y

What is this "burden of proof" and for what purposes is it a useful concept? There are factual questions and people with some capacity and motivation for pursuing them. When social norms dictate how this pursuit should proceed, it's no longer about the questions.

[-]fubarobfusco11y150

One sense of "burden of proof" seems to be a game-rule for a (non-Bayesian) adversarial debate game. It is intended to exclude arguments from ignorance, which if permitted would stall the game. The players are adversaries, not co-investigators. The player making a novel claim bears the burden of proof — rather than a person criticizing that claim — so that the players actually have to bring points to bear. Consider:

A: God loves frogs. They are, above all other animals, sacred to him.
B: I don't believe it.
A: But you can't prove that frogs aren't sacred!
B: Well of course not, it never occurred to me to consider as a possibility.

At this point the game would be stalled at zero points.

The burden-of-proof rule forbids A's last move. Since A started the game by making a positive claim — the special status of frogs — A has to provide some evidence for this claim. B can then rebut this evidence, and A can present new evidence, and then we have a game going:

A: God loves frogs. They are, above all other animals, sacred to him.
B: I don't believe it.
A: Well, the God Book says that God loves frogs.
B: But the God Book also says that chickens are a kind of flea, and modern taxonomy shows... (read more)

8Alejandro111y

I like this framing, but "burden of proof" is also used in other contexts than arguments from ignorance. For example, two philosophers with opposing views on consciousness might plausibly get stuck in the following dialog: A: If consciousness is reducible, then the Chinese room thinks, Mary can know red, zombies are impossible, etc.; all these things are so wildly counterintuitive that the position that the burden of proof falls on those who claim that consciousness is reducible. B: Consciousness being irreducible would go so completely against all the scientific knowledge we have gained about the universe that the burden of proof falls on those who assert that. Here "who has the burden of proof?" seems to be functioning as a non-Bayesian approximation for "whose position has the lowest prior probability?" The one with the lowest prior probability is the one that should give more evidence (have a higher P(E|H)/P(E)) if they want their hypothesis to prevail; in absence of new evidence, the one with the highest prior wins by default. The problem is that if the arguers have genuinely different priors this leads to stalemate, as in the example. ETA: tl.dr, what Stabilizer said.

0Transfuturist11y

I'm not sure how Mary knowing red follows from reducible consciousness. Knowing everything (except the experience) of red does not the experience of red make.

0Alejandro111y

It is certainly debatable, but there are philosophers who make this argument, and I only used it as an example.

5sixes_and_sevens11y

"Burden of proof" is also formally assigned under judicial frameworks. "Presumed innocent until proven guilty" and "beyond reasonable doubt" are examples of such assignations. Outside of a legal context, I tend to assume that if someone in a discussion has made an appeal to "burden of proof", that discussion is probably not a fruitful one.

4Kaj_Sotala11y

If someone is (or seems like they might be) privileging the hypothesis, it seems reasonable to say that the burden of proof is on them, not just as a social norm but also as a question of epistemology. In other words, if there are a hundred boxes where the diamond could be and I claim that it's in box number 27, then it's reasonable that I ought to provide some evidence for this claim, rather than requiring the other person to come up with a hypothesis for why my claim would be false. There are an infinite number of false hypotheses, and if we try to test them all rather than focusing on the most promising ones, we'll never get anywhere.

0[anonymous]11y

This is covered by the motivation clause in grandparent. If you give me a bad question, I won't be motivated to work on it. I may even be uninterested in your meticulously researched answer.

4Stabilizer11y

0[anonymous]11y

Its probability is different in estimates of the people who disagree, and its best alternative will find the status of having "low probability" in estimate of different people. Just "low probability" doesn't make the situation asymmetric. You should spend the resources when there is high value of information, otherwise do something else. Improving someone else's beliefs may have high value for them.

0[anonymous]11y

If you want to [test] a low [value of information] hypothesis, you change your mind and stop wanting that. What happens is that people disagree on the probabilities.

2brazil8411y

But there is never "complete absence of any evidence." For example, if I claim to you that I have an invisible flying pig in my backyard, we both have a lifetime of experiences to draw on which are inconsistent with such a claim. e.g. witnessing pigs and similar animals running around but not flying; feeling solid objects which have always been visible in normal light; and so on. So I would bear the burden of proving my claim.

[-]Oscar_Cunningham11y-20

So much for starting open threads on a Monday.

-1NancyLebovitz11y

I'd forgotten that-- I'd just noticed that we were running past the end date on the previous thread. It won't be a big deal to let this one stretch till a week from tomorrow.

0Tenoke11y

Uhm, we weren't.

Moderation Log

206Comments