A critique of effective altruism

Disclaimer: I like and support the EA movement.

I agree with Vaniver, that it would be good to give more time to arguments that the EA movement is going to do large net harm. You touch on this a bit with the discussion of Communism and moral disagreement within the movement, but one could go further. Some speculative ways in which the EA movement could have bad consequences:

The EA movement, driven by short-term QALYs, pulls effort away from affecting science and policy in rich countries with long-term impacts to brief alleviation of problems for poor humans and animals
AMF-style interventions increase population growth and lower average world income and education, which leads to fumbling of long-run trajectories or existential risk
The EA movement screws up population ethics and the valuation of different minds in such a way that it doesn't just fail to find good interventions, but pursues actively terrible ones (e.g. making things much worse by trading off human and ant conditions wrongly)
Even if the movement mostly does not turn towards promoting bad things, it turns out to be easier to screw things up than to help, and foolish proponents of conflicting sub-ideologies collectiv

... (read more)

[-]benkuhn12y140

Hmm. I didn't interpret a hypothetical apostasy as the fiercest critique, but rather the best critique--i.e. weight the arguments not by "badness if true" but by something like badness times plausibility.

But you may be right that I unconsciously biased myself towards arguments that were easier to solve by tweaking the EA movement's direction. For instance, I should probably have included a section about measurability bias, which does seem plausibly quite bad.

[-]joaolkf12y160

I don't have time to explain it now, so I will state the following with the hope merely stating it will be useful as a data point. I think Carl's critique was more compelling, more relevant if true (which you agree), and also not that much less likely to be true than yours. Certainly, considering the fact of how destructive they would be if true, and the fact they are almost as likely to be true as yours, I think Carl's is the best critique.

In fact, the 2nd main reason I don’t direct most of my efforts to what most of the EA movement is doing is because I do think some weaker versions of Carl’s points are true. (The 1st is simply that I’m much better at finding out if his points are true and other more abstract things than at doing EA stuff).

3Vaniver12y

This does show up in the poor cause choices section, and I'm not sure it deserves a section of its own (though I do suspect it's the most serious reason for poor cause selection, beyond the underlying population ethics being bad).

0Ratcourse12y

"Hmm. I didn't interpret a hypothetical apostasy as the fiercest critique, but rather the best critique--i.e. weight the arguments not by "badness if true" but by something like badness times plausibility." See http://www.amirrorclear.net/academic/papers/risk.pdf. Plausibility depends on your current model/arguments/evidence. If the badness times probability of these being wrong dwarfs the former, you must account for it.

0christopherj12y

Odds are if someone benefits from doing a hypothetical apostasy, then they can't be trusted to be accurate in terms of plausibility. You'd want at least to get the worst case scenario for plausibility, or simply neglect plausibility and later make sure that the things you feel are "very implausible" are in fact very implausible. I'm slightly suspicious of the whole hypothetical apostasy -- it feels like proofreading, but I find it almost impossible to thoroughly proof myself. Wouldn't it be easier and better to find well-qualified critics, if these exist, and leave hypothetical apostasy for when decent critics can't be found? Although I suppose that it would already have been implied by hypothetical apostasy, as it would be a lazy apostate who didn't research support for his position. The Elitist Philanthropy of So-Called Effective Altruism Enterprise Is the Most “Effective Altruism” I suppose a problem with other critics is that their values likely differ from yours.

3benkuhn12y

Yes, I don't consider either the CEO of a GiveWell competitor or a couple of theologians to be well-qualified to critique effective altruism. Part of my motivation in writing this was specifically the abysmal quality of such critiques. I think that e.g. Michael Vassar is a much more qualified outside critic (outside in the sense of not associating with the EA movement) and indeed several of my arguments here were inspired by him (as filtered through my ability to interpret his sometimes oracular remarks, so he can feel free to disown the results, though he hasn't yet). Some of what I'm doing is making these outside critiques more visible to effective altruists--although arguably a true outsider would be able to make them more forcefully through lack of bias, Vassar understandably would rather spend his time on other stuff, so the best workable option is writing them up myself.

0christopherj12y

I didn't mean that you can just take other people's critiques as sound nor unbiased, but I can guarantee you that the GiveWell competitor won't share your bias. In theory, you're even his intended audience (liking EA but not 100% convinced), which means that if he's doing his job right the arguments would be tailored to you. (Though I suspect tailoring an argument for rationalists might require different skills than tailoring it for other types of groups.)

3Davidmanheim12y

Many of these issues seem related to arrow's impossibility theorem; if groups have genuinely different values, and we optimize for one set not another, ants get tiny apartments and people starve, or we destroy the world economy because we discount too much, etc. To clarify, I think LessWrong thinks most issues are simple, because we know little about them; we want to just fix it. As an example, poverty isn't solved for good reasons; it's hard to balance incentives and growth, and deal with heterogeneity, there exist absolute limits on current wealth and the ability to move it around, and the competing priorities of nations and individuals. It's not unsolved because people are too stupid to give money to feed the poor charities. We underestimate the rest of of the world because we're really good at one thing, and think everyone is stupid for not being good at it - and even if we're right, we're not good at (understanding) many other things, and some of those things matter for fixing these problems.

7homunq12y

Note: Arrow's Impossibility Theorem is not actually a serious philosophical hurdle for a utilitarian (though related issues such as the Gibbard-Satterthwaite theorem may be). That is to say: it is absolutely trivial to create a social utility function which meets all of Arrow's "impossible" criteria, if you simply allow cardinal instead of just ordinal utility. (Arrow's theorem is based on a restriction to ordinal cases.)

1Davidmanheim12y

Thank you for the clarification; despite this, cardinal utility is difficult because it assumes that we care about different preferences the same amount, or definably different amounts. Unless there is a commodity that can adequately represent preferences (like money) and a fair redistribution mechanism, we still have problems maximizing overall welfare.

1homunq12y

No argument here. It's hard to build a good social welfare function in theory (ie, even if you can assume away information limitations), and harder in practice (with people actively manipulating it). My point was that it is a mistake to think that Arrow showed it was impossible. (Also: I appreciate the "thank you", but it would feel more sincere if it came with an upvote.)

1Davidmanheim11y

I had upvoted you. Also, I used Arrow as a shorthand for that class of theorem, since they all show that a class of group decision problem is unsolvable - mostly because I can never remember how to spell Satterthewaite.

[-]Eliezer Yudkowsky12y480

I had the same sense of "This is the kind of criticism where you say 'we need two Stalins'" as one of the commenters. That doesn't mean its correct, and I, like some others, particularly liked the phrase "pretending to actually try". It also seems to me self-evident that this is a huge step forward and a huge improvement over merely pretending to try. Much of what is said here is correct, but none of it is the kind of criticism which would kill EA if it were correct. For that you would have to cross over into alleging things which are false.

From my perspective, by far the most obvious criticism of EA is to take the focus on global poverty at face value and then remark that from the pespective of 100,000,000 years later it is unlikely that the most critical point in this part of history will have been the distribution of enough malaria nets. Since our descendants will reliably think this was not the most utility-impactful intervention 100,000,000 years later, we should go ahead and update now, etc. And indeed I regard the non-x-risk parts of EA as being important only insofar as they raise visibility and eventually get more people involved in, as I would put it, the actual plot.

[-][anonymous]12y100

Excuse me, but this sounds to me like a terrible argument. If the far future goes right, our descendents will despise us as complete ignorant barbarians and won't give a crap what we did or didn't do. If it goes wrong (ie: rocks fall, everyone dies), then all those purported descendents aren't a minus on our humane-ness ledger, they're a zero: potential people don't count (since they're infinite in number and don't exist, after all).

Besides, I damn well do care how people lived 5000 years ago, and I would certainly hope that my great-to-the-Nth-grandchildren will care how I live today. This should especially matter to someone whose idea of the right future involves being around to meet those descendents, in which case the preservation of lives ought to matter quite a lot.

God knows you have an x-risk fetish, but other than FAI (which carries actual benefits aside from averting highly improbable extinction events) you've never actually justified it. There has always been some small risk we could all be wiped out by a random disaster. The world has been overdue for certain natural disasters for millenia now, and we just don't really have a way to prevent any of them. Space colon... (read more)

2michaeldello9y

I think future humans are definitely worthy of consideration. Consider placing a time bomb in a childcare centre for 6 year old kids set to go off in 10 years. Even though the children who will be blown up don't yet exist, this is still a bad thing to do, because it robs those kids of their future happiness and experience. If you subscribe to the block model of the universe, then time is just another dimension, and future beings exist in the same way that someone in the room over who you can't see also exists.

1[anonymous]9y

Well, it's definitely a bad thing to do because it kills the children. I dunno if I'd follow that next inference ;-). Luckily, I don't. It works well for general relativity at the large scale, but doesn't yet some to integrate well with the smallest scales of possible causality at the quantum level. I think that a model which ontically elides the distinction between past, present, and future as "merely epistemic" is quite possibly mistaken and requires additional justification. I realize this makes me a naive realist about time, but on the other hand, I just don't see which predictions a "block model" actually makes about causality that account for both the success of general relativity and my very real ability to make interventions such as bombing or not bombing (personally, I'd prefer not bombing, there's too many damn bombs lately) a day-care. You might say "you've already made the choice and carried out the bombing in the future", but then you have to explain what the fundamental physical units of information are and how they integrate with relativity to form time as we know it in such a way that there can be no counterfactuals, even if only from some privileged informational reference frame. In fact, the lack of privileged reference frames seems like an immediate issue: how can there be a "god's eye view" where complete information about past, present, and future exist together without violating relativity by privileging some reference frame? Relativity seems configured to allow loosely-coupled causal systems to "run themselves", so to speak, in parallel, without some universal simulator needing a global clock, so that synchronization only happens at the speed-of-light causality-propagation rate.

0John_Maxwell12y

Nick Bostrom has written some essays arguing for the prioritization of existential risk reduction over other causes, e.g. this one and this one. I agree with your last paragraph.

-2Lumifer12y

Do you, now? And how does that caring manifest itself?

3Armok_GoB12y

Presumably by staying on the lookout for opportunities to get their hands on a time machine.

3[anonymous]12y

Hand me a time machine and you'll find out!

1Lumifer12y

Go look for blue Public Call Police Boxes :-P

2gjm12y

If I'm correctly understanding the subtext of that question ("if it doesn't affect what you actually do besides talking, it's meaningless to say you care about it") then I respectfully disagree. I am quite happy to say that A cares about B if, e.g., A's happiness is greatly affected by B. If it happens that A is able to have substantial effect on B, then (1) we may actually be more interested in the question "what if anything does A do about B?", which could also be expressed as "does A care about B?", and (2) if the answer is that A doesn't do anything about B, then we might well doubt A's claims that her happiness is greatly affected by B. But in cases like this one -- where, so far as we know, there is and could be nothing whatever that A can do to affect B -- I suggest that "cares about" should be taken to mean something like "has her happiness affected by", and that asking what A does about B is simply a wrong response. (Note 1. I am aware that I may be quite wrong about the subtext of the question. If an answer along the lines of "It manifests itself as changes in my emotional state when I discover new things about the lives of people 5000 years ago or when I imagine different ways their lives might have been" would have satisfied you, then the above is aimed not at you but at a hypothetical version of you who meant something else by the question.) (Note 2. You might say that caring about something you can't influence is pointless and irrelevant. That might be correct, though I'm not entirely convinced, but in any case "how does that caring manifest itself?" seems like a strange thing to say to make that point.)

2Dias12y

I feel guilty for not living in ways that would be approved of by our ancestors.

9benkuhn12y

Judging by the overwhelmingly favorable response, it certainly came out as we-need-two-Stalins criticism, whether or not I "intended" it that way. (One of the less expected side effects of this post was to cause me to update towards devoting more time to things that, unlike writing, don't give me a constant dribble of social reinforcement.) I think my criticism includes yours, in the following sense: if we solve the "we fail to converge on truth because too much satisficing" problem, we will presumably stop saying things like "but global poverty could totally be the best thing for the far future!" (which has been argued) and start to find the things that are actually the best thing for the far future without privileging certain hypotheses.

[-]Lumifer12y120

start to find the things that are actually the best thing for the far future

I have strong doubts about your (not personal but generic) ability to evaluate the far-future consequences of most anything.

2maia12y

This is my main problem with the idea that we should have a far-future focus. I just have no idea at all how to get a grip on far-future predictions, and so it seems absurdly unlikely that my predictions will be correct, making it therefore also absurdly unlikely that I (or even most people) will be able to make a difference except in a very few cases by pure luck.

6atucker12y

It seems easier to evaluate "is trying to be relevant" than "has XYZ important long-term consequence". For instance, investing in asteroid detection may not be the most important long-term thing, but it's at least plausibly related to x-risk (and would be confusing for it to be actively harmful), whereas third-world health has confusing long-term repercussions, but is definitely not directly related to x-risk. Even if third world health is important to x-risk through secondary effects, it still seems that any effect on x-risk it has will necessarily be mediated through some object-level x-risk intervention. It doesn't matter what started the chain of events that leads to decreased asteroid risk, but it has to go through some relatively small family of interventions that deal with it on an object level. Insofar as current society isn't involved in object-level x-risk interventions, it seems weird to think that bringing third-world living standards closer to our own will lead to more involvement in x-risk intervention without there being some sort of wider-spread availability of object-level x-risk intervention. (Not that I care particularly much about asteroids, but it's a particularly easy example to think about.)

2satt12y

I'm inclined to agree. A possible counterargument does come to mind, but I don't know how seriously to take it: 1. Global pandemics are an existential risk. (Even if they don't kill everyone, they might serve as civilizational defeaters that prevent us from escaping Earth or the solar system before something terminal obliterates humanity.) 2. Such a pandemic is much more likely to emerge and become a threat in less developed countries, because of worse general health and other conditions more conducive to disease transmission. 3. Funding health improvements in less developed countries would improve their level of general health and impede disease transmission. 4. From the above, investing in the health of less developed countries may well be related to x-risk. 5. Optional: asteroid detection, meanwhile, is mostly a solved problem. Point 4 seems to follow from points 1-3. To me point 2 seems plausible; point 3 seems qualitatively correct, but I don't know whether it's quantitatively strong enough for the argument's conclusion to follow; and point 1 feels a bit strained. (I don't care so much about point 5 because you were just using asteroids as an easy example.)

1Strange712y

Any given asteroid will either be detected and deflected in time, or not. There, to my understanding at least, no mediocre level of asteroid impact risk management which makes the situation worse, in the sense of outright increasing the chance of an extinction event. More resources could be invested for further marginal improvements, with no obvious upper bound. Poverty and disease are more complicated problems. Incautious use of antibiotics leads to disease-resistant strains, or you give a man a fish and he spends the day figuring out how to ask you for another instead of repairing his net. Sufficient resources need to be committed to solve the problem completely, or it just becomes even more of a mess. Once it's solved, it tends to stay solved, and then there are more resources available for everything else because the population of healthy, adequately-capitalized humans has increased. In a situation like that, my preferred strategy is to focus on the end-in-sight problem first, and compare the various bottomless pits afterward.

0michaeldello9y

I would have to disagree that there is no mediocre way to make asteroid risk worse through poor impact risk management, but perhaps it depends on what we mean by this. If we're strictly talking about the risk of some unmitigated asteroid hitting Earth, there is indeed likely nothing we can do to increase this risk. However, a poorly construed detection, characterisation and deflection process could deflect an otherwise harmless asteroid into Earth. Further, developing deflection techniques could make it easier for people with malicious intent to deflect an otherwise harmless asteroid into Earth on purpose. Given how low the natural risk of a catastrophic asteroid impact is, I would argue that the chances of a man-made asteroid impact (either on purpose or by accident) is much higher than the chances of a natural one occurring in the next 100 years.

0gjm12y

Yes, most x-risk reduction will have to come about through explicit work on x-risk reduction at some point. It could still easily be the case that working on improving the living standards of the world's poorest people is an effective route to x-risk reduction. In practice, scarcely anyone is going to work on x-risk as long as their own life is precarious, and scarcely anyone is going to do useful work on x-risk reduction if they are living somewhere that doesn't have the resources to do serious scientific or engineering work. So interventions that aim, in the longish term, to bring the whole world up to something like current affluent-West living standards seem likely to produce a much larger population of people who might be interested in reducing x-risk and better conditions for them to do such work in.

0atucker12y

See the point about why its weird to think that new affluent populations will work more on x-risk if current affluent populations don't do so at a particularly high rate. Also, it's easier to move specific people to a country than it is to raise the standard of living of entire countries. If you're doing raising-living-standards as an x-risk strategy, are you sure you shouldn't be spending money on locating people interested in x-risk instead?

5gjm12y

I quite agree that if all you care about is x-risk then trying to address that by raising everyone's living standards is using a nuclear warhead to crack a nut. I was addressing the following thing you said: which I think is clearly wrong: bringing everyone's living standards up will increase the pool of people who have the motive and opportunity to work on x-risk, and since the number of people working on x-risk isn't zero that number will likely increase (say, by 2x) if the size of that pool increases (say, by 2x) as a result of making everyone better off. I wasn't claiming (because it would be nuts) that the way to get the most x-risk bang per buck is to reduce poverty and disease in the poorest parts of the world. It surely isn't, by a large factor. But you seemed to be saying it would have zero x-risk impact (beyond effects like reducing pandemic risk by reducing overall disease levels). That's all I was disagreeing with.

1Eugine_Nier12y

This logic suffers from an "infinity discontinuity" problem: Consider a hypothetical paperclip maximizer. It has some resources, it has to choose between using them to make paperclips or using them to develop more efficient ways of gathering resources. A basic positive feedback calculation means the latter will lead to more paperclips in the long run. But if it keeps using that logic, it will keep developing more and more efficient ways of gathering resources and never actually get around to making paperclips.

3Gurkenglas12y

In this situation, a maximizer can't work anyway because there is no maximum.

-2Eugine_Nier12y

Well, there are states that are better than others.

2ialdabaoth12y

Can't this be solved through exponential discounting? If paperclips made later are discounted more than paperclips made sooner, then we can settle on a stable strategy for when to optimize vs. when to execute, based on our estimations of optimization returns at each stage being exponential, super-exponential, or sub-exponential.

2Gurkenglas12y

Finding a problem with the simple algorithm that usually gives you a good outcome doesn't mean you get to choose a new utility function.

0Gurkenglas12y

Clarifying anti-tldr edit time! If you got the above, no need to read on. (I wanted this to be an edit, but apparently I fail at clicking buttons) The simple algorithm is the greedy decision-finding method "Choose that action which leads to one-time-tick-into-future self having the best possible range of outcomes available via further actions", which you think could handle this problem if only the utility function employed exponential discounting (whether it actually could is irrelevant, since I adress another point). But your utility function is part of the territory, and the utility function that you use for calculating your actions is part of the map; it is rather suspicious that you want to tweak your map towards a version that is more convenient to your calculations.

0owencb12y

There are questions about why we should discount at all, or if we are going to, how to choose an appropriate rate. But even setting those aside: this isn't any more of a solution than the version without discounting. They're similarly reliant on empirical facts about the world (the rate of resource growth); they just give differing answers about how fast that rate needs to be before you should wait rather than cash out.

-3Eugine_Nier12y

Yes, but Eliezer doesn't believe in discounting terminal values.

3ialdabaoth12y

So, let's be clear - are we talking about what works, or what we think Eliezer is dumb for believing?

-6Eugine_Nier12y

0Strange712y

Unless, or rather until, it hits diminishing returns on resource-gathering. Maybe an ocean, maybe a galaxy, maybe proton decay. With the accessible resources fully captured, it has to decide how much of that budget to convert directly into paperclips, how much to risk on an expedition across the potential barrier, and how much to burn gathering and analyzing information to make the decision. How many in-hand birds will you trade for a chance of capturing two birds currently in Andromeda?

1Jonathan_Graehl12y

I read this as presuming that generating/saving more humans is a worse use of smart/rich people's attention and resources than developing future-good theory+technology (or maybe it's only making more malaria-net-charity-recipients and their descendants that isn't a good investment toward those future-good things, but that's not likely to figure, since we can save quite a few lives at a very favorable ratio). I wonder if you meant that it's a worse use because we have more people alive now than is optimal for future good, or because we only want more smart people, or something else.

0MugaSofer12y

I don't think he's saying that saving net-recipients is bad, or pointless. So I doubt either of those suggestions are correct.

[-]Vaniver12y270

Cross-posted from http://www.benkuhn.net/ea-critique since I want outside perspectives, and also LW's comments are nicer than mine.

They are! I wish I had realized you cross-posted this here before I commented there. So also cross-posting my comment:

First, good on you for attempting a serious critique of your views. I hope you don’t mind if I’m a little unkind in responding to to your critique, as that makes it easier and more direct.

Second, the cynical bit: to steal Yvain’s great phrase, this post strikes me as the “we need two Stalins!” sort of apostasy that lands you a cushy professorship. (The pretending to try vs. actually trying distinction seems relevant here.) The conclusion- “we need to be sufficiently introspective”- looks self-serving from the outside. Would being introspective happen to be something you consider a comparative advantage? Is the usefulness of the Facebook group how intellectually stimulating and rigorous you find the conversations, or how many dollars are donated as a result of its existence?

Third, the helpful bit: instead of saying “this is what I think would make EA slightly less bad,” consider an alternative prompt: ten years from now, you look bac... (read more)

6benkuhn12y

Thanks for cross-posting! You didn't realize because I didn't think to cross-post until after you had commented there. (Sorry for being unclear.) I've added a link to this cross-post to the text on benkuhn.net for people who want to comment. Go ahead! Obviously this is important enough that Crocker's Rules apply. You've correctly detected that I didn't spend as much time on the conclusion as the criticisms. I actually debated not proposing any solutions, but decided against it, for a couple reasons: 1. The solution is essentially "we need to actually care about these problems I just listed" but phrased more nicely. I think any solution to the problems I listed involves actually caring about them more than we currently do. 2. The end of this post is the best place I could think of to propose a solution that would actually get people's attention. 3. I didn't want to end without saying anything constructive. Incidentally, I don't actually consider being thoughtful about social dynamics a comparative advantage. I think we need more, like, sociologists or something--people who are actually familiar with the pitfalls of being a movement. I see now that it's not obvious from the finished product, but this was actually the prompt I started with. I removed most of the doom-mongering (of the form "these problems are so bad that they are going to sink EA as a movement") because I found it less plausible than the actual criticisms and wanted to maximize the chance that this post would be taken seriously by effective altruists. But I stand by these criticisms as the things that I think are most likely to torpedo EA right now. I'm less concerned about one of the principles failing than I am that the principles won't be enough--that people won't apply them properly because of failures of epistemology.

6Vaniver12y

That deflates that criticism. For the object-level social dynamics problem, I think that people will not actually care about those problems unless they are incentivised to care about those problems, and it's not clear to me that is possible to do. What does the person who EA is easy for look like? My first guess is a person who gets warm fuzzies from rigor. But then that suggests they'll overconsume rigor and underconsume altruism. Is epistemology the real failing, here? This may just be the communism analogy, but I'm not seeing how the incentive structure of EA is lined up with actually getting things done rather than pretending to actually get things done. Do you have a good model of the incentive structure of EA? Interesting. The critique you've written strikes me as more "nudging" than "apostasy," and while nudging is probably more effective at improving EA, keeping those concepts separate seems useful. (The rest of this comment is mostly meta-level discussion of nudging vs. apostasy, and can be ignored by anyone interested in just the object-level discussion.) I interpreted the idea of apostasy along the lines of Avoiding Your Belief's Real Weak Points. Suppose you knew that EA being a good idea was conditional on there being a workable population ethics, and you were uncertain if a workable population ethics existed. Then you would say "well, the real weak spot of EA is population ethics, because if that fails, then the whole edifice comes crashing down." This way, everyone who isn't on board with EA because they're pessimistic about population ethics says "aha, Ben gets it," and possibly people in EA say "hm, maybe we should take the population ethics problem more seriously." This also fits Bostrom's idea- you could tell your past self "look, past Ben, you're not taking this population ethics problem seriously, and if you do, you'll realize that it's impossible and EA is wasted effort." (And maybe another EAer reads your argument and is motivated to find

[-]Will_Sawin12y150

Arguably trying for apostasy, failing due to motivated cognition, and producing only nudging is a good strategy that should be applied more broadly.

2Vaniver12y

A good strategy for what ends?

8Will_Sawin12y

Finding good nudges!

7Jiro12y

This seems to encourage Pascal's mugging. In fact, it's even worse than Pascal's mugging; in Pascal's mugging, at least the large amount of possible damage has to be large enough that the expected value is large even after considering its small probability. Here, the amount of possible damage just has to be large and it doesn't even matter that the plausibility is small. (If you think plausibility can't be substituted for probability here, then replace "Pascal's mugging" with "problems greatly resembling Pascal's mugging").

0Vaniver12y

This is one reason why I think the argument is only moderately strong.

0Strange712y

Maybe include plausibility, but put some effort into coming up with pessimistic estimates?

6benkuhn12y

Re your meta point (sorry for taking a while to respond): I now agree with you that this should not be called a "(hypothetical) apostasy" as such. Evidence which updated me in that direction includes: 1. Your argument 2. Referencing a "hypothetical apostasy" seems to have already lead to some degradation of the meaning of the term; cf. Diego's calling his counter-argument also an apostasy. (Though this may be a language barrier thing?) 3. This article got a far more positive response than my verbal anticipations expected (though possibly not than System 1 predicted). Thanks for calling this out. Should I edit with a disclaimer, do you think?

1Vaniver12y

No problem! That's what I like to hear! :P Probably. If you want do the minimal change, I would rewrite the "how to read this" section to basically be just its last paragraph, with a link to something that you think is a better introduction to EA, and maybe a footnote explaining that you originally wrote this as a response to the apostasy challenge but thought the moderate critique was better. If you want to do the maximal change, I would do the minimal change and also post the "doom-mongering" parts you deleted, probably as a separate article. (Here, the disclaimer is necessary, though it could be worded so that it isn't.)

3MichaelVassar12y

I think that this is an effective list of real weak spots. If these problems can't be fixed, EA won't do much good.

2benkuhn12y

I don't think EA has to worry about incentive structure in the same way that communism does, because EA doesn't want to take over countries (well, if it does, that's a different issue). Fundamentally we rely on people deciding to do EA on their own, and thus having at least some sort of motivation (or, like, coherent extrapolated motivation) to actually try. (Unless you're arguing that EA is primarily people who are doing it entirely for the social feedback from people and not at all out of a desire to actually implement utilitarianism. This may be true; if it is, it's a separate problem from incentives.) The problem is more that this motivation gets co-opted by social-reward-seeking systems and we aren't aware of that when it happens. One way to fix this is to fix incentives, it's true, but another way is to fix the underlying problem of responding to social incentives when you intended to actually implement utilitarianism. Since the reason EA started was to fix the latter problem (e.g. people responding to social incentives by donating to the Charity for Rare Diseases in Cute Puppies), I think that that route is likely to be a better solution, and involve fewer epicycles (of the form where we have to consciously fix incentives again whenever we discover other problems). I'm also not entirely sure this makes sense, though, because as I mentioned, social dynamics isn't a comparative advantage of mine :P (Responding to the meta-point separately because yay threading.)

[-]CarlShulman12y190

I don't think EA has to worry about incentive structure in the same way that communism does, because EA doesn't want to take over countries (well, if it does, that's a different issue)

GiveWell is moving into politics and advocacy, there are 80k people in politics, and GWWC principals like Toby Ord do a lot of advocacy with government and international organizations, and have looked at aid advocacy groups.

0Strange712y

In a more general sense, telling some large, ideologically-cohesive group of people to take as much of their money as they can stand to part with and throw it all at some project, and expecting them to obey, seems like an intrinsically political act.

[-]ColonelMustard12y140

EA doesn't want to take over countries

"Take over countries" is such an ugly phrase. I prefer "country optimisation".

[-]Vaniver12y100

Unless you're arguing that EA is primarily people who are doing it entirely for the social feedback from people and not at all out of a desire to actually implement utilitarianism. This may be true; if it is, it's a separate problem from incentives.

I think that the EA system will be both more robust and more effective if it is designed with the assumption that the people in it do not share the system's utility function, but that win-win trades are possible between the system and the people inside it.

5MichaelVassar12y

I think that attempting effectiveness points towards a strong attractor of taking over countries.

5atucker12y

Social feedback is an incentive, and the bigger the community gets the more social feedback is possible. Insofar as Utilitarianism is weird, negative social feedback is a major reason to avoid acting on it, and so early EAs must have been very strongly motivated to implement utilitarianism in order to overcome it. As the community gets bigger, it is less weird and there is more positive support, and so it's less of a social feedback hit. This is partially good, because it makes it easier to "get into" trying to implement utilitarianism, but it's also bad because it means that newer EAs need to care about utilitarianism relatively less. It seems that saying that incentives don't matter as long as you remove social-approval-seeking ignores the question of why the remaining incentives would actually push people towards actually trying. It's also unclear what's left of the incentives holding the community together after you remove the social incentives. Yes, talking to each other probably does make it easier to implement utilitarian goals, but at the same time it seems that the accomplishment of utilitarian goals is not in itself a sufficiently powerful incentive, otherwise there wouldn't be effectiveness problems to begin with. If it were, then EAs would just be incentivized to effectively pursue utilitarian goals.

3pianoforte61112y

I've been thinking about point 6. I think its actually quite obvious in hindsight. People really only care about themselves and people close to them either due to personal connections, physical closeness (like being a neighbor) or similar characteristics. Altruism starts off with the assumption that all lives have equal value which doesn't reflect the values that people actually have. Charity has signaling purpose (it allows you to signal that you are the kind of person that cares) and a selfish purpose (it makes you feel good) but its not really about helping the people most in need. In the drowning child example, I think the response that an honest non-utilitarian would give is that there is no moral obligation to save the drowning child if you aren't connected to them in any way. Moreover this might not be a bad thing, capitalism works partly because of selfishness and while I realize that is probably motivated cognition speaking, I think its worth considering that it might be okay that people value lives unconnected to them much lower.

0Strange712y

Even in the absence of a moral obligation, saving a drowning child to whom you are not otherwise connected (or getting first aid training in anticipation of such an opportunity, etc.) might still be a very worthwhile investment, with the right follow-up. In addition to broader reputational effects, there's the possibility of a debt of gratitude from the child and any associated parents or guardians which would broaden and diversify your social circle, without giving those approached an opportunity to resent the intrusion.

[-]lukeprog12y250

Good work! Though, this is much weaker than my model of a hypothetical apostasy, which is informed by my actual deconversion from Christianity, which involved writing a thoroughly withering critique of theism and Christianity, not a "here's how Christianity could be tweaked and improved."

If I were to write a hypothetical apostasy for EA, I might take the communism part further and try to argue that enacting global policies on the basis of unpopular philosophical views was likely to be disastrous. Or maybe that real-world utilitarianism is so far from intuitive human values (which have lots of emotional deontological principles and so on) that using it in the real world would cause the humans to develop all kinds of pathologies. Or something more damning that what you've written. But if you published such a thing then you'd have lots more people misunderstand it and be angry at you, too. :)

Edit: I see that Carl has said this better than I did.

1benkuhn12y

Since you delegated to Carl, I responded to him.

[-]Nick_Beckstead12y180

I'd like to see more critical discussion of effective altruism of the type in this post. I particularly enjoyed the idea of "pretending to actually try." People doing sloppy thinking and then making up EA-sounding justifications for their actions is a big issue.

As Will McAskill said in a Facebook comment, I do think that a lot of smart people in the EA movement are aware of the issues you're bringing up and have chosen to focus on other things. Big picture, I find claims like "your thing has problem X so you need to spend more resources on fixing X" more compelling when you point to things we've been spending time on and say that we should have done less of those things and more of the thing you think we should have been doing. E.g., I currently spend a lot of my time on research, advocacy, and trying to help improve 80,000 Hours and I'd be pretty hesitant to switch to writing blogposts criticizing mistakes that people in the EA community commonly make, though I've considered doing so and agree this would be help address some of the issues you've identified. But I would welcome more of that kind of thing.

I disagree with your perspective that the effective altrui... (read more)

5benkuhn12y

The main thing that I personally think we don't need as much of is donations to object-level charities (e.g. GiveWell's top picks). It's unclear to me how much this can be funged into more self-reflection for the general person, but for instance I am sacrificing potential donations right now in order to write this post and respond to criticism... I think in general, a case that "X is bad so we need more of fixing X" without specific recommendations can also be useful in that it leaves the resource allocation up to individual people. For instance, you decided that your current plans are better than spending more time on social-movement introspection, but (hopefully) not everyone who reads this post will come to the same conclusion. I think "writing blogposts criticizing mistakes that people in the EA community commonly make" is a moderate strawman of what I'd actually like to see, in that it gets us closer to being a successful movement but clearly won't be sufficient on its own. Why do you think basic fact-finding would be particularly helpful? Seems to me that if we can't come to nontrivial conclusions already, the kind of facts we're likely to find won't help very much.

6jefftk12y

These donations are useful for establishing credibility as a real movement and not just "people talking on the internet".

5benkuhn12y

Yes, I'm well aware. I never said they were completely unuseful, just that IMO the marginal value is lower than resources spent elsewhere.

0Pablo12y

Also, as Ben notes,

0jefftk12y

Still not so sure. Legibility and inferential distance are major constraints here. When trying to explain earning to give it's much easier if the "give" part is something obviously good. Donor-advised funds combined with an intention to choose effective charities aren't "obviously good" in the same way as a donation to a charity.

2Nick_Beckstead12y

I am substantially less enthusiastic about donations to object-level charities (for their own sake) than I am for opportunities for us to learn and expand our influence. So I'm pretty on board here. That was my first pass at how I'd try to start to try to increase the "self-awareness" of the movement. I would be interested in hearing more specifics about what you'd like to see happen. A few reasons. One is that the model for research having an impact is: you do research --> you find valuable information --> people recognize your valuable information --> people act differently. I have become increasingly pessimistic about people's ability to recognize good research on issues like population ethics. But I believe people can recognize good research on stuff like shallow cause overviews. Another consideration is our learning and development. I think the above consideration applies to us, not just to other people. If it's easier for us to tell if we're making progress, we'll learn how to learn about these issues more quickly. I believe that a lot of the more theoretical stuff needs to happen at some point. There can be a reasonable division of labor, but I think many of us would be better off loading up on the theoretical side after we had a stronger command of the basics. By "the basics" I mean stuff like "who is working on synthetic biology?" in contrast with stuff like "what's the right theory of population ethics?". You might have a look at this conversation I had with Holden Karnofsky, Paul Christiano, Rob Wiblin, and Carl Shulman. I agree with a lot of what Holden says.

[-]MichaelVassar12y170

This is MUCH better than I expected from the title. I strongly agree with essentially the entire post, and many of my qualms about EA are the result of my bringing these points up with, e.g. Nick Beckstead and not seeing them addressed or even acknowledged.

[-]Nick_Beckstead12y170

I would love to hear about your qualms with the EA movement if you ever want to have a conversation about the issue.

Edited: When I first read this, I thought you were saying you hadn't brought these problems up with me, but re-reading it it sounds like you tried to raise these criticisms with me. This post has a Vassar-y feel to it but this is mostly criticism I wouldn't say I'd heard from you, and I would have guessed your criticisms would be different. In any case, I would still be interested in hearing more from you about your criticisms of EA.

[-]MichaelVassar12y170

I spent many hours explaining a sub-set of these criticisms to you in Dolores Park soon after we first met, but it strongly seemed to me that that time was wasted. I appreciate that you want to be lawful in your approach to reason, and thus to engage with disagreement, but my impression was that you do not actually engage with disagreement, you merely want to engage with disagreement, basically, I felt that you believe in your belief in rational inquiry, but that you don't actually believe in rational inquiry.

I may, of course, be wrong, and I'm not sure how people should respond in such a situation. It strongly seems to me that a) leftist movements tend to collapse in schizm, b) rightist movements tend to converge on generic xenophobic authoritarianism regardless of their associated theory. I'd rather we avoid both of those situations, but the first seems like an inevitable result of not accommodating belief in belief, while the second seems like an inevitable result of accommodating it. My instinct is that the best option is to not accommodate belief in belief and to keep a movement small enough that schizm can be avoided. The worst thing for an epistemic standard is not th... (read more)

8Nick_Beckstead12y

What I mostly remember from that conversation was disagreeing about the likely consequences of "actually trying". You thought elite people in the EA cluster who actually tried had high probability of much more extreme achievements than I did. I see how that fits into this post, but I didn't know you had loads of other criticism about EA, and I probably would have had a pretty different conversation with you if I did. Fair enough regarding how you want to spend your time. I think you're mistaken about how open I am to changing my mind about things in the face of arguments, and I hope that you reconsider. I believe that if you consulted with people you trust who know me much better than you, you'd find they have different opinions about me than you do. There are multiple cases where detailed engagement with criticism has substantially changed my operations.

4joaolkf12y

I'm partially unsure if I should be commenting here since I do not know Nick that well, or the other matters that could be involved in this discussion. Those two points nevertheless, not only it seems to me that your impression of him is mistaken, but that the truth lies in the exact opposite direction. If you check his posts and other writings, it seems he has the remarkable habit of taking into consideration many opposing views (e.g.: his thesis) and also putting a whole more weight into others opinions (e.g.: common as sense as a prior) than the average here at LW. I would gather others must have, at worst, a different opinion of him than the one you presented, otherwise he wouldn't be in the positions he's right now, both at FHI and GWWC. That's my two cents. Not even sure if he would agree with all of it, but I would image some data points wouldn't do harm.

[-][anonymous]12y130

As a practicing socialist, I found the comparison to Communism illuminating and somewhat disturbing.

You've already listed some of the major, obvious aspects in which the Effective Altruism movement resembles Communism. Let me add another: failure to take account of local information and preferences.

Information: Communism (or as the socialists say: state capitalism, or as the dictionaries say: state socialism -- centrally planned economies!) failed horrifically at the Economic Calculation Problem because no central planning system composed of humans can take account of all the localized, personal information inherent in real lives. Markets, on the other hand, can take advantage of this information, even if they're not always good at it (see for a chuckle: "Markets are Efficient iff P=NP"). Effective altruism, being centrally planned, suffers this problem.

Preferences: the other major failure of Communist central planning was its foolish claim that the entirety of society had a single, uniform set of valuations over economic inputs and outputs which was determined by the planning committee in the Politburo. The result was, of course, that the system produced vast amounts... (read more)

3Lumifer12y

Hold on a second. This is news to me. What is it about EA being centrally planned?

5atucker12y

My guess is that Eli is referring to the fact that the EA community seems to largely donate to where GiveWell says to donate, and that a lot of the discourse is centered around a system of trying to figure out all of the effects of a particular intervention, weigh it against all other factors, and then come up with a plan of what to do, where said plan is incredibly sensitive to you being right about the prioritization, facts about the situation, etc. in a way that will cause you to predictably fail to do as well as you could, due to factors like lack of on-the-ground feedback suggesting other important areas, misunderstanding people's values, errors in reasoning, and a lack of diversity in attempts to do something so that if one of the parts fails nothing gets accomplished. I tend to think that global health is relatively non-controversial as a broad goal (nobody wants malaria! like, actually nobody) that doesn't suffer from the "we're figuring out what other people value" problem as much as other things, but I also think that that's almost certainly not the most important thing for people to be dealing with now to the exclusion of all else, and lots of people in the EA community seem to hold similar views. I also think that GiveWell is much better and handling that type of issue than people in the EA community are, but that (at least the facebook group) is somewhat slow to catch up.

1[anonymous]12y

At a first reapproximation to my thinking a week ago, I was thinking of things like this. Many acts of "charity" often consist of trying to manage the lives of the unfortunate for them, and evidence is emerging that, well, the unfortunate know their own needs better than we do: we should empower them and leave them "free to optimize", so to speak. Not that malaria relief or anything is a bad cause, but I generally have more "feeling" regarding poverty myself, since combating poverty over the middle-term (longer than a year, shorter than a generation, let's say) tends to result in the individual benefactors becoming able to solve a lot of their other problems, and has generational knock-on effects (such as: reduced poverty leads to better nutrition and better building materials, meaning healthier, smarter children over time, meaning people can do more to solve their remaining issues, etc.). And then I was also definitely thinking about people trying to "do maximum good" through existential-risk reduction donations (including MIRI, but not just MIRI), and how these donations tend to be... dubiously effective. Sure, we're not dead yet, but very few organizations can evidentially demonstrate that they're actively reducing the probability that we all die. That is, if I want to be less-probably dead next year than this year, I don't know to whom to donate. EDIT: Regarding the latter paragraph, I wish to note that I did give MIRI $72 this past year, this being calculated as the equivalent price of several Harry Potter novels for which the author deserved payment. If I become convinced that MIRI/FHI are actually effective in ensuring both that AI doesn't kill us all off, and that they can do better than throw the human species in a permanent Medieval Stasis (ie: that they can "save the world"), resulting in the much-lauded futuristic utopia they use for their recruiting pitches, I will donate larger sums quite willingly. I also want to actually engage in the scientific/p

-2Lumifer12y

Yes, but the (currently prevalent) alternative is not central planning, but rather the proliferation of a variety of different "let-us-manage-your-lifestyle" organizations. Actually, I can't think of any. But still, what does this all have to do with central planning?

5[anonymous]12y

Would you like me to amend from "central" planning to "external" planning? As in, organizations who attempt to plan people's lives in an interfering sort of way? Sorry, I just want to check if we're about to get into a massive argument about vocabulary or whether there's some place we are actually talking about the same thing.

1Nornagest12y

Interesting; I hadn't previously thought much about the analogy between (macro) economic planning and (micro) goods-and-services-oriented charity, and it probably does deserve some thought. Still, the analogy isn't exact. If we're talking about basic necessities, things like food and clothes, then the argument seems strong: people's exact needs will differ in ways that aren't easy to predict, and direct distribution of goods will therefore incur inefficiencies that cash transfers won't. I'm pretty sure that GiveWell and its various peers know about these pitfalls, as evidenced by GiveDirectly's consistently high ranking. But I can also think of situations where there are information, infrastructure, or availability problems to overcome -- market defects, in other words -- that cash won't do much for in the medium term, and it's plausible to me that many of the EA community's traditional beneficiaries do work in this space. As to existential risk... well, that's a completely different approach. To borrow a phrase from GiveWell's blog, existential risk reduction is an extreme charity-as-investment strategy, and there's very little decent analysis covering it. I don't entirely trust MIRI's in-house estimates, but I couldn't point you to anything better, either.

0[anonymous]12y

Well, you just raised my opinion of GiveWell.

0Lumifer12y

I guess it's mostly a terminology thing. I associate "central planning" with things like the USSR and it was jarring to see an offhand reference to EA being centrally planned. If we redefine things in terms of external management/control vs. just providing resources without strings attached, I don't know if we disagree much.

6[anonymous]12y

In that case, I think I could spend part of the evening hammering out what precisely our differences are, or I could get off LessWrong and do my actual job. Currently choosing the latter.

0fubarobfusco12y

This seems like a noncentral use of "centrally planned", meaning something like "there exists a highly influential opinion leader" ... or else a noncentral use of "EA", meaning something like "give all your money to GiveWell and let them sort it out".

0Lumifer12y

Given that the context is comparison to communism, your explanation doesn't look likely. But I'm sure Eli can explain his meaning if he wants to.

-3Eugine_Nier12y

It's centrally planned in the sense that the optimizer behind it is a committee/bureaucracy, as opposed to say a market. Of course, a market in charity tries to optimize warm fuzzies so I don't know of a better solution. Edit: Or rather the problem is that effective charity is a credence good.

[-]John_Maxwell12y110

Tangential: has their been discussion on LW of the EA implications of having kids? Personally, I would expect that having kids would at least be positive expected utility since they would inherit a good number of your genes/memes and be more likely than a person randomly chosen from the population to become effective altruists. But the opportunity costs seem really high.

I'm also curious how people feel about increasing fertility among reasonably smart people in general.

[-]Adele_L12y100

Yes.

3Pablo12y

There are much cheaper and faster ways to increase the total number of EAs than procreation. Suppose some EA donor is considering spending half a million dollars in EA movement-building. Would anyone in his right mind think that the most effective thing this person can do is to pay that sum of money to an EA who wants to have a child but couldn't otherwise afford it? (Having a child costs about USD 0.5 million, according to this source. If you think this estimate is inaccurate, just rerun the argument above with your chosen figure.)

0John_Maxwell12y

If EAs never procreate then in the long run all of the genes that would cause one to become an EA will get selected out of the population. So yes, right now there is fairly low-hanging fruit in terms of EA movement-building that does not involve having children. But in the long run it's definitely something we want EAs to be doing.

0Lumifer12y

Create? That's interesting terminology.

0Pablo12y

I changed it to

[-]passive_fist12y100

I think a lot of these criticisms are very valid. Many of them are stuff I had been thinking about but your post does a really good job of explaining them better than I ever could.

I guess I have a somewhat unique take on the whole EA thing, since I'm one of the few (probably) non-white people here. I'd be happy to elaborate if you wish.

4benkuhn12y

Yes, I'd love to hear you elaborate. More perspectives are great! (I'd also be happy to talk 1:1 if you'd prefer that to a public forum.)

5passive_fist12y

Well, I honestly can't tell if my perspective is because I'm not white, or if it's just because I'm an anomaly. But this paragraph is very worrying to me: There seems to be this meme that white people are not aware of other cultures and are blinded to the realities of the world because they are rich and coddled and so on. It seems to be fashionable to point this out at any possible opportunity.. Regardless of the validity of that statement, my concern is that promoting multiculturalism has the danger of backlash i.e. by encouring too much tolerance of other cultures, you alienate a large fraction of people (this goes back to your 'community problems' point). I've been seeing this go on over the past decade in the West.

[-]Ishaan12y240

It has nothing to do with white people - it has to do with cross cultural misunderstandings in general. People just use the word "white" frequently because of certain implicit assumptions about the racial / cultural background of the audience.

Anyway, let me give you an example of when this sort of thing actually happens: In India, there used to be religious figures called Devadasis. They are analogous to nuns in one sense - they get "married" to divinity, and never take a human spouse. Unlike nuns, they are trained in music and dancing. In medieval India, music, dancing, and sexual services were all lumped under the same general category...as in, there was a large overlap between dancers, musicians, and sex workers, and this was widely recognized. (This is not really true today, but if you watch really old Indian movies you can see remnants of this association). We can presume that many of the Devadasis engaged in sex work. It should be noted that they also had a high social status, which allows us to further infer that the sex work probably didn't involve intense coercion and probably wasn't driven by extremely harsh economic pressures.

You can guess where this ... (read more)

3benkuhn12y

Misjudging "the good" was essentially what I think the postmodernist-fluffy critics mean when they raise this objection. Thanks for the example!

5Viliam_Bur12y

You could also write your perspective without having to worry about why exactly you have it. I'd appreciate if you wrote more, specifically more details, so I have less to guess about what exactly you wanted to say. And I am curious about it. (In case this is a cultural thing, e.g. you feel it is impolite to express your opinions on a topic unless other people are constantly encouraging you to tell more, then you have my explicit encouragement to express your opinions fully, whether here or anywhere else on LW. And of course that includes the cases where you disagree with me.)

0benkuhn12y

My impression is that in this particular community, emphasizing multiculturalism without some obvious instrumental benefit is if anything an anti-applause-light. I'd like to echo John Maxwell IV in asking for examples. Specifically if there's a way you see EA becoming more humanistically aware in a way that is instrumentally useful to the object-level goal of doing good, but harmful to the meta-goal of growing the movement because it alienates a large fraction of their potential audience (and this is worse than their increased capacity to do good). I can't come up with things that seem plausible to me, though this may be my brain being silly again.

0John_Maxwell12y

Could you give an example or two?

[-]jefftk12y90

Effective altruists often express surprise that the idea of effective altruism only came about so recently. For instance, my student group recently hosted Elie Hassenfeld for a talk in which he made remarks to that effect, and I’ve heard other people working for EA organizations express the same sentiment. But no one seems to be actually worried about this—just smug that they’ve figured out something that no one else had.

I do think this is worrying, or at least worth looking into. This is part of why I've been looking into the history of earning to giv... (read more)

[-]Brian_Tomasik12y70

Thanks, Ben. I agree with about half of the points and disagree with the other half. I think some of the claims, e.g., that other people haven't raised these issues, are untrue.

Effective altruists often express surprise that the idea of effective altruism only came about so recently. [...] But no one seems to be actually worried about this—just smug that they’ve figured out something that no one else had.

Honestly, I think this idea is one of EA's bigger oversights -- not that people haven't noticed that EA is recent, but that people don't realize that ... (read more)

[-]EHeller12y60

I recently ran across Nick Bostrom’s idea of subjecting your strongest beliefs to a hypothetical apostasy in which you try to muster the strongest arguments you can against them.

This is generally known as playing the devil's advocate, and its an idea that long predates Nick Bostrum.

2Said Achmiz12y

Playing the devil's advocate is when Alice is arguing for some position, and Bob is arguing against it, even though he does not actually disagree with Alice (perhaps because he wants to help Alice strengthen her arguments, clarify her views, etc.). Hypothetical apostasy is when Alice plays her own devil's advocate, in essence, with no Bob involved.

4homunq12y

... And that is not a new idea either. "Allow me to play the devil's advocate for a moment" is a thing people say even when they are expressing support before and after that moment.

[-]Davidmanheim12y60

(Edit, Later. This is related to the top level replies by CarlShulman and V-V, but I think it's a more general issue, or at least a more general way of putting the same issues.)

I'm wondering about a different effect: over-quantification and false precision leading to bad choices in optimization as more effort goes into the most efficient utility maximization charities.

If we have metrics, and we optimize for them, anything that our metrics distort or exclude will have an exaggerated exclusion from our conversation. For instance, if we agree that maximizing... (read more)

3homunq12y

I think you've done better than CarlShulman and V_V at expressing what I see as the most fundamental problem with EA: the fact that it is biased towards the easily- and short-term- measurable, while (it seems to me) the most effective interventions are often neither. In other words: how do you avoid the pathologies of No Child Left Behind, where "reform" becomes synonymous with optimizing to a flawed (and ultimately, costly) metric? This issue is touched by the original post, but not at all deeply.

[-]DylanEvans12y50

To my mind, the worst thing about the EA movement are its delusions of grandeur. Both individually and collectively, the EA people I have met display a staggering and quite sickening sense of their own self-importance. They think they are going to change the world, and yet they have almost nothing to show for their efforts except self-congratulatory rhetoric. It would be funny if it wasn't so revolting.

1homunq12y

Upvoted because I think this is a real issue, though I'm far from sure whether I'd put it at "worst".

[-]V_V12y40

A few thoughts (disclaimer: I do NOT endorse effective altruism):

The main reason most people donate to charities may be to signal status to others, or to "purchase warm fuzzies" (a form of status signalling to one's own ego).
Effective altruists claim to really care about doing good with their donations, but theirs could be just a form of status signalling targeted at communities where memes such as consequentialism, utilitarianism, and "rationality" are well received, and/or similarly a way to "purchase warm fuzzies" for som

... (read more)

4benkuhn12y

Yes, I think this there are people for whom this is true. However, the best way to get such people to actually do good is to make "pretending to actually do good" and "actually doing good" equivalently costly, by calling them out when they do the latter (EDIT: former). I personally want effective altruism to actually do good, not just satisfy people's social desires (though as Diego points out, this is also important). If it turns out that the point of the EA movement becomes to help people signal to a particular consequentialist set, then my hypothetical apostasy will become an actual apostasy, so I'm still going to list this as a critique. GiveWell spends a lot of time making estimating their performance easier (nearly everything possible is transparent, "mistakes" tab prominently displayed on the website, etc.). And I know some people take their raw material (conversations, etc.) and come to fairly different conclusions based on different values. GiveWell also solicits external reviews. I think this is as good of an incentive structure as we're going to get (EDIT: not actually--as Carl Shulman points out, more competitors would be better, but without a lot of extra effort, it's hard to beat). Fundamentally, it seems like anything altruistic we do is going to have to rely on at least a few "heroic" people who are responding to a desire to actually do good rather than social signalling. Everything else you said, I agree with. Are those your totality of reasons for not endorsing EA? If not, I'd like to hear your others (by PM if you like).

[-]CarlShulman12y130

GiveWell spends a lot of time making estimating their performance easier (nearly everything possible is transparent, "mistakes" tab prominently displayed on the website, etc.). And I know some people take their raw material (conversations, etc.) and come to fairly different conclusions based on different values. GiveWell also solicits external reviews.

I think this is as good of an incentive structure as we're going to get

I think it would be better with more competitors in the same space keeping each other honest.

3benkuhn12y

Ah, good point. Weakened.

1Eugine_Nier12y

Not necessarily, a lot of competitors might result in competition on providing plausible fuzzes rather than honesty.

2Vaniver12y

I'm not sure what you mean by the last clause. Do you mean "calling them out when they do the former"? Or do you mean "making the primary way to pretend to actually do good such that it actually does good"?

2benkuhn12y

I meant "former". Sorry for the confusion.

2V_V12y

This is nice to hear. Still, you have to trust them to report their own shortcomings accurately. And if more and more people join EA for status reasons, GiveWell and related organizations may become less incentivized to achieve high performance. Mostly these are the reasons I can think of. Maybe I could also add that donations to people in impoverished communities might create market distortions with difficult to asses results, but I suppose that this could be lumped in the estimation difficulties category of objections.

3weeatquince12y

This is not true (and incidentally is a pet peeve of mine). I know plenty of EAs who are not utilitarian EAs. Most EAs I know would dispute this (at least in conversation on the EA facebook group there appears to be a consensus that EA ≠ utilitarianism). I am curious as to what makes you (/anyone) think this. Could you enlighten me? This statement also interests me too. What do you mean that you do not endorse EA? * Are you referring to the idea of applying reason/rationality to doing good? * Are you saying that you do not support the movement or the people in it? * Do you simply mean that advocating EA just happens to be a thing you have never done? * Are you not altruistic/ethical?

1V_V12y

Effective altruism is not the same as utilitarianism, but it is certainly based on it. How else would you call trying to maximize a numeric measure of cumulative good? I think I've already responded in the parent comment.

3weeatquince12y

This is incorrect. Effective altruism is applying rationality to doing good (http://en.wikipedia.org/wiki/Effective_altruism). It is not always maximizing. For example you could be EA and not believe you should ever actively cause harm (ie you would not kill one person to save 5). It does require quantifying things, as much as making any other rational decision requires quantifying things. No you have not. You have expressed criticisms of things EAs do. The OP expressed lots of criticisms too but still actively endorses EA. I ask mainly because I agree with many of your criticisms, but I still actively endorse EA. And I wonder at what point on the path we differ.

1V_V12y

Fair enough. I think it could be said that while the philosophy behind EA is rooted in total utilitarianism, people who practice EA can further constrain it within a deontological moral system. (I suppose that this true even of people who explicitly proclaim themselves utilitarians). I wonder that too. If you agree with many of my criticisms, why do you still endorse EA?

-1EALE12y

The term "EA" is undoubtedly based on a form of total utilitarianism. Whatever the term means today, and whatever Wikipedia says (which, incidentally, weeatquince helped to write, though I can't remember if he wrote the part he is referring to), the motivation behind the creation of the term was the need for a much more palatable and slightly broader term for total utilitarianism.

2Rob Bensinger12y

I don't understand what this means. How does one signal to one's 'ego'? What information is being conveyed, and to whom? These could both be true at different explanatory levels. What are we taking to be the site of 'really caring'? The person's conscious desires? The person's conscious volition and decision-making? The person's actions and results? What's the import of the distinction? Presumably we should treat actions as obligatory when that makes the world a better place, and as non-obligatory but praiseworthy when that makes the world a better place. Does there need to be a fact of the matter about how mad morality will be at you if you don't help people? Take two otherwise as-identical-as-possible worlds, and make everything obligatory in one world, nothing obligatory in the other. What physical or psychological change distinguishes the two?

3V_V12y

I'm talking about self-deception, essentially. A perfectly rational agent would not be able to do that, but people aren't perfectly rational agents, and they are capable of self deception, and sometimes they do that deliberately, sometimes it is unconscious. Wishful thinking and Confirmation bias are instances of this. Consider Revealed preferences. Are someone's actions more consistent with their stated goals or with status seeking and signalling? I'm not sure I can follow you here. This looks like circular reasoning.

5benkuhn12y

I'm not sure what RobBB meant, but something like this, perhaps:

0TheAncientGeek12y

Praising and blaming oneself seems a ubiquitous feature of life to me...but then I am starting from an observation, not from a theory of how egos work.

[-]Ishaan12y30

Philosophical difficulties

The main insight of the EA movement is to pick some criteria and go with it (rather than the "warm fuzzies" heuristic that most people use).

What criteria you use is up to you and your preferences.

Poor cause choices

or marketable cause choices. Uncontroversial cause choices. The act of giving a recommendation is also outcome focused...you have to think about what percentage of your audience will actually be moved to act as a result of your announcement. Effective Altruism for a meta-charity also means Effective Ad... (read more)

[-]Desrtopa12y30

The “market” for ideas is at least somewhat efficient: most simple, obvious and correct things get thought of fairly quickly after it’s possible to think them.

This may be tautological depending on how you define your terms (if people don't think of an idea quickly after it's possible to do so, it wasn't obvious.)

If defined in such a way that it could possibly be false, of course, it very much begs further evidence.

2benkuhn12y

The most compelling example I'm familiar with is the large number of mathematical breakthroughs that are made nearly simultaneously by multiple people. See e.g. here:

2Desrtopa12y

This is certainly sometimes the case. On the other hand, while it often happens in heavily competitive fields where people are employed all around the world for full time research, it may be rather different when it comes to producing ideas or answering questions where nobody is being employed to address them at all, and anyone who does so is doing it on their own initiative.

[-]joaolkf12y30

One of the plausible ways EA could be worsening instead of improving resources allocation is if, in fact, resources are better with the very rich instead of the very poor countries. I do not believe this question was rightly assessed by the EA movement. More often than not, it is just assumed as evident resources are better on the hands of the ones who don't have it, which would make sense inside an egalitarian-ethics, but not on utilitarianism. I do know there are texts, articles, etc. on this question, but I do not think they are nearly enough given how ... (read more)

7CarlShulman12y

I think the standard long-run argument here would be that it's much cheaper to influence conditions in the very poor countries: a given chunk of altruistic resources will be larger relative to poor countries and smaller relative to rich countries, and the cost difference could outweigh a difference in desirability of the outcomes purchased. And, of course in the short-term marginal utility of income is many times higher in poor countries.

[-]diegocaleiro12y20

I have written a lengthy response that deals with only one of the points in the critique above, the suggestion that, as a whole, the Effective Altruist movement is pretending to really try, here: http://lesswrong.com/r/discussion/lw/j8v/in_praise_of_tribes_that_pretend_to_try/

My main argument is that pretending to try is quite likely *a good thing(, in the grand scheme of EA.

Disclaimer: I support the EA movement.

[-]TsviBT12y20

"I only regret that I have but one upvote to give for this post."

[-]Philip_W12y10

Concerning historical analogues: From what I understand about their behaviour, it seems like the Rotary Club pattern-matches some of the ideas of Effective Altruism, specifically the earning-to-give and community-building aspects. They have a million members who give on average over $100/yr to charities picked out by Rotary Club International or local groups. This means that in the past decade, their movement has collected one billion dollars towards the elimination of Polio. Some noticeable differences include:

I can't find any mention of Rotary spending

... (read more)

[-][anonymous]10y00

[This comment is no longer endorsed by its author]Reply

[-]Evan_Gaensbauer11y00

I wish to write a one-year retrospective and/or report on this post. I'll contact Ben Kuhn to run this idea by him, to see if he would be interested. If he's too busy, as I expect he might be, I at least hope to seek his blessing to extend the mission of critiquing effective altruism.

There are also other critiques, like this one. Additionally, there have been counters and defenses in response to this post in the previous year. Further, specific to effective altruism, e.g., on the effective altruism forum, there has been more discussion of these ideas. I w... (read more)

1riceissa9y

Hi Evan, did you ever write this post?

0[anonymous]10y

Ping!

[-]EALE12y00

"for a community that purports to put stock in rationality and self-improvement, effective altruists have shown surprisingly little interest in self-modification to have more altruistic intentions. This seems obviously worthy of further work." I would love to see more work done on this. However, I understand "wanting to have more altruistic intentions" as part of a broader class of "wanting to act according to my ultimate/rational/long-term desires rather than my immediate desires", and this doesn't seem niche enough for membe... (read more)

[-]Benjamin_Todd12y00

Hi Ben,

Thanks for the post. I think this is an important discussion. Though I'm also sympathetic to Nick's comment that a significant amount of extra self-reflection is not the most important thing to EA's success.

I just wanted to flag that I think there are attempts to deal with some of these issues, and explain why I think some of these issues are not a problem.

Philosophical difficulties

Effective altruism was founded by philosophers, so I think there's enough effort going into this, including population ethics. (See Nick's comment)

Poor cause choices

There... (read more)

3benkuhn12y

Hi Ben, Thanks for responding. I've responded to points below. The point of this argument wasn't that organizations aren't working on it. In fact the existence of this research strengthens my point, which was that people are donating now anyway despite the fact that it looks like we know very little now and the attitude towards giving now vs. later seems to be "well there's a good case for either one" rather than "we really need to figure this out because we may be pouring money down the drain", which is evidence that people are stopping thinking at the level of "doesn't obviously conflict with EA principles". Again, the issue isn't that nobody is trying to solve these, it's that most people are way more worried about the charity analysis issue than ancillary issues that are just as important. If our knowledge of e.g. cost-effectiveness of global health interventions was as limited as our knowledge elsewhere, would people be donating to global health charities? I doubt it. I've been following 80k and have not noticed this phenomenon. Can you give some examples? This is definitely not all we can do (unless you take a tautologically broad interpretation of "make an active effort to reach out"). For instance, if a substantial fraction of effective altruists were raging sexists, it would be wise to fix our group norms before going "hey women! there's this thing called effective altruism!" Even supposing it is all we can do, is there anything we're actually doing about it? The point of the critique was not to list easily avoidable problems, but to list bad problems. If decline in quality of people is inevitable, then we better find some solutions to the problems it brings (e.g. epistemic inertia), or the decline of EA is inevitable too.

-2Benjamin_Todd12y

Read the response to poor cause choice and inconsistent attitude toward rigor as "while some EAs might be donating without enough thought, lots of others are investing most of their resources in doing more research" The monoculture problem is something we often think about how to fix at 80k. We haven't come up with great solutions yet though. I also argued that the decline in the FB group is not obviously important. And if it's difficult to avoid, but many movements started by a small group of smart people nevertheless go on to achieve a lot, that's also evidence that it's not important.

[-]Josh You12y00

Another possible critique is that the philosophical arguments for ethical egoism are (I think) at least fairly plausible. The extent to which this is a critique of EA is debatable (since people within the movement state that it's compatible with non-utilitarian ethical theories and that it appeals to people who want to donate for self-interested reasons) but it's something which merits consideration.

LESSWRONG
LW

LESSWRONG
LW

100

A critique of effective altruism

100

100

How to read this post

Abstract

Philosophical difficulties

Poor cause choices

Non-obviousness

Efficient markets for giving

Inconsistent attitude towards rigor

Poor psychological understanding

Historical analogues

Monoculture

Community problems

Movement building issues

Conclusion

Are these problems solvable?

Acknowledgments