The book is by William MacAskill, founder of 80000 Hours and Giving What We Can. Excerpt:
Effective altruism takes up the spirit of Singer’s argument but shields us from the full blast of its conclusion; moral indictment is transformed into an empowering investment opportunity...
Either effective altruism, like utilitarianism, demands that we do the most good possible, or it asks merely that we try to make things better. The first thought is genuinely radical, requiring us to overhaul our daily lives in ways unimaginable to most...The second thought – that we try to make things better – is shared by every plausible moral system and every decent person. If effective altruism is simply in the business of getting us to be more effective when we try to help others, then it’s hard to object to it. But in that case it’s also hard to see what it’s offering in the way of fresh moral insight, still less how it could be the last social movement we’ll ever need.
A disagreement could resolve into one side being mostly right and another mostly wrong, so actual harm+benefit isn't necessary, only expected harm+benefit. All else equal, harm+benefit is worse than pure benefit, but usually there are other relevant distinctions, so that the effect of a harm+benefit cause could overwhelm available pure benefit causes.
The disagreements I was talking about - which I clam are many, perhaps most, disagreements - are not about unknown or disputed facts, but about conflicting values and goals. Such disagreements can't be resolved into sides being objectively right or wrong (unless you're a moral realist). If you side with one of the sides, that's the same as saying their desires are 'right' to you, and implementing their desires usually (in most moral theories in practice) outweighs the cost of the moral outrage suffered by those who disagree. (E.g., I would want to free one slave even if it made a million slave-owners really angry, very slightly increasing the incidence of heart attacks and costing more QALYs in aggregate than the one slave gained.)