I really wish this had been two posts. The first one, about the dihonesty of "matching" gifts where the match would have happened regardless, is spot-on, but perhaps too long for some audiences (the smart ones, who already knew this, or only needed a push to think about the counterfactual).
The second, about "good arbitrage" has an interesting idea, which I had trouble teasing out. Is this a recommendation to large donors that they can actually make their match effective by setting up competition across charities (or segments of a charity)? Something like: donate $50K, split between N charities. Decide on the split based on how much the charities collect as "matches'?
Both sections had a confusing mix of target audiences. Are you writing to development departments, large donors (who provide the matches), or small donors (who decide whether to use matching as part of their decision process)? It would have been clearer and simpler if you'd separated them into different sections.
I think the problem here is that you're expecting a post oriented towards specific actionable short-run recommendations. I only really care about doing that to the extent that it makes the overall principle clearer. The good situation isn't one in which people specifically avoid (either as charities or as potential donors) matching donation drives because of the narrow arguments in the post, but one in which people learn the underlying principle, and notice that strategies that reveal information are cooperative, and strategies that conceal or distort information cause harm.
The "good arbitrage" argument cashes out to a recommendation that unless you have strong reason to believe you have epistemic or moral luck in a relevant way, you should be happy to reveal information about your plans, even when this creates the possibility of potential collaborators deciding against investing resources in you, since in general you prefer other good actors to make better, more informed decisions.
strategies that reveal information are cooperative, and strategies that conceal or distort information cause harm.
Agreed, and I wish this had been clearer, earlier in the post.
The "good arbitrage" argument ...
Doesn't that boil down to "arbitrage only happens when information is private"? In a world where everyone shares knowledge (and values, perhaps), the concepts of arbitrage, matching, advertising, structured donations, etc. are all irrelevant. But that's not where we live.
I don't think just shared knowledge is sufficient (e.g. advertising is not about giving you information), and if you invoke Aumann and add the shared values requirement, don't you end up in a situation where everyone is basically the same? You get a hive-mind kind of a society...
Advertising (in which I include matching schemes and other attempts to influence donors) is either: 1) dark arts, at best orthogonal to a charity's mission, at worst contrary to it (if the mission includes raising the sanity waterline). 2) providing information, possibly in order to gather information (i.e. letting donors know how to communicated, not just give).
Benquo's "good arbitrage" seemed to be saying that #2 is desirable, and I don't fully understand the argument. If he's making the argument from crowdsourcing preferences, then that does lead toward a view that there is a "right" answer which we're trying to discover from the hive-mind.
As far as I can understand Benquo's arbitrage argument, it relies on the donor being able to forecast the effectiveness of the program better than the charity itself can. And if you assume the charity and the donor follow the same goal, it makes sense to defer the decision to the better prognosticator.
Anna Salamon, executive director of CFAR (named with permission), recently wrote to me asking for my thoughts on fundraisers using matching donations. (Anna, together with co-writer Steve Rayhawk, has previously written on community norms that promote truth over falsehood.) My response made some general points that I wish were more widely understood:
So I'm putting an edited version of my response here.
Matched donation fundraisers are typically dishonest
In the typical matched donation fundraiser, a large donor pledges to match the donations from everyone else, up to a specified level, such as $500,000. The charity can then claim to other donors that this is an unusually good time to give, because for each dollar they give to the charity, the charity will receive an additional dollar from the matching donor.
There are two levels on which such matched donation offers tend to be dishonest:
GiveWell explains the problem of illusory matching fairly well:
But the main problem with matching donation fundraisers is that even when they aren't lying about the matching donor's counterfactual behavior, they misrepresent the situation by overassigning credit for funds raised.
I'll illustrate this with a toy example. Let's say that a charity - call it Good Works - has two potential donors, Alice and Bob, who each have $1 to give, and don't know each other. Alice decides to double her impact by pledging to match the next $1 of donations. If this works, and someone gives because of her match offer, then she'll have caused $2 to go to Good Works. Bob sees the match offer and reasons similarly: if he gives $1, this causes another $1 to go to Good Works, so his impact is doubled - he'll have caused Good Works to receive $2.
But if Alice and Bob each assess their impact as $2 of donations, then the total assessed impact is $4 - even though Good Works only receives $2. This is what I mean when I say that credit is overassigned - if you add up the amount of funding each donor is supposed to have caused, you get number that exceeds the total amount of funds raised.
If Alice is responsible for $2 of donations, then she has to reason that she's overridden Bob's agency and Bob's not responsible for his actions. If Bob agrees that he gets zero credit, then there's no problem. But if Bob reasons symmetrically to Alice, then each one can coherently think that they moved more than $1, only if they also believe that their agency's been eroded by the match agreement. They can coherently think that the decision is symmetrical, and that they're each responsible for more than $1 of donations, only if they each also agree that they've forfeited some share of their agency or optimization power by letting themselves be enticed by the other's match potential.
I think this is what GiveWell means when discussing what it considers a non-illusory form of matching, "influence matching":
But is this just a nitpick by overly scrupulous moralists, or does it actually cause some harm?
Overassignment of credit obscures opportunity cost
I claim that the moral discomfort some such as GiveWell feel about matching donation fundraisers is related to an actual harm caused by dishonesty: it causes people motivated by it to make worse decisions. I first lay out a simple model of why you might explain overassignment of credit to be good. Then I'll explain how this can instead cause harm.
Coordinating to shift from consumption to giving
Let's go back to the example of Alice and Bob. Alice cares about her personal consumption, and about Good Works, but not about Bob's personal consumption. She'd rather use $1 to buy ice cream than give it to Good Works, but if she can thereby redirect $1 from Bob's personal consumption to Good Works as well, she thinks it's worth it. Bob's preferences are the mirror image of Alice's.
Each of them prefers the world where Good Works gets $2 to the world where they buy ice cream. But if neither thinks they can affect the other's action, then they each prefer to buy ice cream rather than giving $1 to Good Works. Thus, when Alice offers and Bob accepts a match, they move into a world-state they both prefer. This is true regardless of how "moral credit" is assigned.
Harms from double-counting
I suspect that in practice donations trade off against other donations more often than they trade off against consumption. This can lead to real harms from double-counting impact.
Let's consider two new strangers, Carl and Denise, who each have a fixed charity budget of $1. Carl and Denise are effective altruists, and want to maximize total utility with their charity budgets.
Charities A creates 3 utils per dollar, and charity B creates 2 utils per dollar. By default, Carl and Denise will each give to charity A, creating 6 utils.
Charity B approaches Carl with the idea that he make a match offer. Carl jumps at the opportunity to cause $2 to be given to charity B, creating 4 utils, one more than he'd have saved before. Denise finds out about the match offer, and switches her donation to charity B, on the same basis. But the total amount of money moved to charity B is not the "doubled" $2+$2=$4, but just $2, resulting in 4 utils. This is less than before!
In general, the more Carl and Denise care about the same things, the more we should expect that the situation is like this, and not like the prior example with Alice and Bob.
Honest and open coordination
In the above toy example, the harm is directly caused by double-counting. I think this is a generalizable principle - strategies that get people excited about things by overassigning credit or underassigning costs will lead to well-intentioned donors misallocating their resources. So we should instead look for coordination mechanisms that work by clarifying, rather than obscuring, the incentives of the participants.
I'll give two examples of how this might work:
Threshold coordination
There's a version of "matching" that doesn't depend on something like overassigning credit. Let's say there's some program that only makes sense if $X gets spent on it, but your charity budget is $0.1X. You don't really want to dump your money into a money pit for no reason, it's not super likely that your $0.1X makes the difference between funding and not funding the thing, but, if you found nine other people like you, you'd totally go for it.
This is the Kickstarter model: no one pays unless there's enough money pledged to produce the thing people want. This model only makes sense if there really are natural thresholds. One natural threshold for a charity would be the level of long-run funding below which the charity would have to shut down. I can also imagine using a kickstarter-style campaign for special programs. If after prioritizing appropriately, a charity doesn't have enough money to fund project X, but suspect some donors might be especially excited about it, a conditional pledge campaign could make a lot of sense.
GiveWell discusses this as the other non-illusory form of matching:
Thresholds can be helpful and motivating even without conditionality. In its 2015 winter fundraiser, MIRI described how aggressive its program would be at different levels of funding:
This seems like a pretty good thing for a charity to do regardless of whether it provides a coordination mechanism - creating motivation by revealing relevant information seems clearly good. I was more excited about spreading the word about that MIRI fundraiser than I have been about ones shortly before or after.
Predictions are hard, so claimed thresholds for different programs can be misleading. I agree, and have personal experience with this as a CFAR donor. But, I don't think it's dishonest to make mistaken predictions, especially if you indicate your uncertainty - and most especially if you follow up afterwards by checking what happened against what you predicted, and making a serious effort to calibrate your future predictions, taking into account past misalignment.
Giving pledges
In the first toy model, Alice and Bob successfully coordinated towards an outcome better aligned with their preferences. I don't think that it's a chance coincidence that this example involved shifting money from consumption to giving. This makes the opportunity cost argument less relevant, because Bob's next-best option is not valued very highly by Alice, and vice versa.
To some extent, the benefit of this coordination is obscured by linking it to a particular charity. The benefit is in Alice and Bob agreeing to allocate their resources in a more public-spirited way, not in Alice's influence over which charity Bob gives to. I don't see any particular reason to mix these considerations. Why not just coordinate about the first thing, and let each person use their own judgment about what charity is best?
In real life, this looks like the Giving What We Can pledge, in which participants make a public pledge to give 10% of their income to effective charities. (There's also a time-bounded trial pledge.) This is explicitly about shifting money from consumption to giving. If you wanted to use matching mechanisms, you might ask about whether there's anyone who's on the fence about taking the pledge, but would do it if that would move someone else to do so. Then pair them up, and have them take the pledge together.
Some other related pledges:
Best practices tend towards dishonesty
I think the problem with - and prevalence of - matching donations is part of a broader phenomenon. When the activity of extracting money from donors is abstracted away from the other core activities of an organization, like assessing and running programs, best practices tend towards distorting the truth. You end up with money-extraction strategies that work regardless of what the organization is doing, and those aren't going to be honest strategies.
The messaging advice that works for any organization is, necessarily, advice that works for organizations with terrible programs. Making it easy to evaluate your programs on the merits seems unlikely to satisfy this requirement. So standard practice will be to obscure your impact.
But donors still want a better deal. So what do you do? The only "better deal" left is one that anyone could offer, a fully generic one that doesn't depend on the details of your program. Offering "leverage" - a 2-for-1 sale - is a perfect example of this. Both sides of a matching drive get to think that they're buying the other side's participation "for free". Of course, they're not. Strategies that appear to buy influence "for free" only appear to work by hiding the ball.
Risk arbitrage for evil and for good
Genuinely impact-oriented organizations have the opportunity to implement a different class of strategies that compete less directly with the typical charity. In particular, if you're uncertain how effective your program is, you mainly care about raising money in the scenarios where your program is effective. This means that some fundraising and communication strategies that increase your organization's financial risk carry much less downside risk from an impact perspective. In particular, in the scenarios where your program isn't effective, you shouldn't treat failing to raise funds as a cost at all.
I'll explain risk arbitrage in the normal case of finance, where it's a best practice to cheat clients. Then I'll explain how it applies to philanthropy, and can be used for good.
Hedge fund roulette
Matthew Yglesias uses roulette as a metaphor for hedge funds' strategies, in order to explain why hedge fund managers have an incentive to pursue risk even if it doesn't benefit their clients:
Here's how the "roulette" strategy looks to the hedge fund manager: At the beginning of each period, you take all your assets under management and distribute them evenly on the roulette numbers 1-35. Each of these numbers has a 1/37 chance of coming up. If the roulette ball lands on one of your numbers, you get 35 times the amount of money you put on that number, plus your initial bet back. If you're managing a $35 fund, you'd have $1 on each number, so you'd end up with $36, a 1/35 or 2.8% gain. On the other hand, if the ball lands on 0 or 36, you lose all the money. At the end of each period, you get paid 15% of the return on your fund. That means that if you win, you get paid 15% / 35 = 0.43% of assets under management. If you lose, you get nothing. So each period, your expected payout is 15% / 35 * (35 / 37) = 0.4% of assets under management.
Here's how the "roulette" strategy looks to the client: In "winning" periods, your holdings appreciate by (100% - 15%) / 35 = 2.43%, after accounting for the hedge fund manager's fee. In "losing" periods, your holdings decline by 100%. So your expected return is 85% / 35 * 35 / 37 - 100% * 2 / 37 = -115% / 37 = -3.1%. Not a good deal!
It's rational for hedge fund managers like John Meriwether to play roulette, because they make money when the client wins, but don't lose money when the client loses.
Risk arbitrage for good
What's the analogous altruistic risk-arbitrage strategy? If I'm running a charity because I care about having a positive impact about the world, then I only care about raising more funds if my program is effective at improving things. If my fundraising strategy has a risk of letting donors correctly conclude that my program doesn't work, and consequently declining to fund it, then I don't count that as a cost.
To most charities, this seems like an increase in risk. But from an altruistic perspective, you're reallocating funding from the possible worlds where your charity doesn't work, to the worlds where it does, and this is an unambiguous gain.
I'm going to start by working through a simple quantitative illustration of this principle. (Skip it if the principle already seems trivially true.) Then I'll give a few examples of how someone might implement this kind of strategy.
Value of revealing information
Let's say that after evaluating your program as well as you can, you think it has a 50% chance of not working, and a 50% chance of saving a life for each $1,000 of funding. So your expected cost per life saved is $2,000. There's a philanthropist with a million dollars considering your program. Their next best option has a cost per life saved of $4,000.
Because the philanthropist knows that they have imperfect information and you might be misleading them, they discount your effectiveness estimates by another 50%, so that from their perspective both programs look equally good. They split their donation 50-50. By your estimate, they have saved $500,000 / $2,000 + $500,000 / $4,000 = 375 lives.
If you reveal more detailed information about your program, this could cause them to reallocate money to your program, if your case is persuasive. They could also reallocate money to the other program, if they correctly spot problems in your plan that you'd missed. To keep things simple, let's say that if you reveal information about your program, there's a 75% chance that they correctly judge which program works and reallocate all their money to that one, and a 25% chance that they reallocate all their money to the worse program.
You already think there's a 50% chance your program doesn't work at all. In that scenario, if you reveal information, there's a 75% chance they fund the other organization fully, saving 250 lives, and a 25% chance that they decide to fund yours, saving no lives.
Then there's a 50% chance your program saves lives for $1,000. In that scenario, if you reveal information, there's a 75% chance that they fund your organization fully, saving 1,000 lives, and a 25% chance that they reallocate funds to the other organization, saving 250 lives.
Thus, the expected number of lives saved, if you reveal the information, is 50% * (75% * 250 + 25% * 0) + 50% * (75% * 1,000 + 25% * 250) = 500. This is a substantial improvement!
You did not increase the expected funding level of your organization. Instead of a 100% chance of 50% funding, you got a 50% * 75% + 50% * 25% = 50% chance of 100% funding. But what you did was reallocate your chance of getting funded, from the possible worlds where your program doesn't work, into the possible worlds where it does.
Ways to reveal information
Instead of trying to optimize for appeal subject to honesty constraints, you might try writing a funding pitch to maximize the chance that someone already trying to fund something like your organizaiton would recognize it as the organization they're looking for. This pays off disproportionately when donors agree with your judgment, which is some evidence that your judgment is correct.
Relatedly, if you argue for your plans, exposing your premises clearly enough that if you're making a mistake, donors should be able to spot any mistake easily. This is likely to be more persuasive, in the scenario where potential donors don't find mistakes or evidence of poor performance or prospects, at the price of being less persuasive, in the scenario where they do. It also opens you up to the upside risk of having someone correct an error in the planning stage, instead of having to try the thing before finding out it doesn't work.
GiveWell is an excellent example of an organization that has written publicly about the reason for its actions. I gave an example above. (It also promotes charities that are willing to make themselves easier to evaluate.) I'm also in the middle of publishing a series of blog posts critiquing GiveWell based on the extensive information they've made publicly available. GiveWell even has a mistakes page, specifically highlighting its failings. This is the sort of thing you do when you want to succeed only in the worlds where you're doing the right thing.
(Disclosure: I worked for GiveWell in the past. I don't anymore and don't expect to in the future, but am still on good terms with current and former GiveWell staff.)
The point of this argument isn't so much to raise specific suggestions. Mainly, I'm hoping to promote the broader hypothesis to your attention: that this is a class of strategy that's not a standard "best practice," but works if you care about expected impact rather than conventional "success".
I also hope this is an illustrative example of a broader principle: that things like honesty really are the best policy, that non-universalizable behavior really does tend to have nasty unintended consequences, that you should have a strong bias toward doing the right thing.
Utilitarian considerations shouldn't be weighed against deontological scruples as though they were competing interests. While the articulable benefits of rule-breaking scale with the importance of the action, the unintended drawbacks are likely to similarly scale. We should override our moral inhibitions, not because it's really important this time - not because the benefits are unusually large - but when we have some specific reason to believe that the costs are unusually small.
(Cross-posted from my personal blog.)