CarlShulman comments on Heuristics and Biases in Charity - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (55)
You have strong reason not to do this anyway because of risk aversion. This is like saying, "Should you serve butter or margarine to your guests? To get a better intuition, consider the selfish version, where you are yourself going to eat either pristine butter, or a container of margarine that has been poisoned with arsenic?"
I agree this is an issue, and that you should take manipulable signals as weaker evidence because of Goodhart's Law. But this effect doesn't automatically dominate. Selecting for good expected value with your best efforts incentivizes efforts to produce signals of value, through real as well as fakeable signals.
Note that GiveWell and friends do not follow your heuristic: the great majority of funds flow to the top charity. They take into account the possibility of faked data (to mess with CBA) in their evaluation process, valuing independent verification, defenses against publication bias, audits, and so forth. But in light of those efforts, they think that the benefits of incentivizing (and assisting) more effective and transparent charities outweigh the risk of incentivizing fakers who can defeat their strong countermeasures.