How do I evaluate the expertise of experts?
This is a difficult problem whose implications go well beyond evaluating charities. Many people seem to defer their evaluation of experts to the experts, but then you have to figure out how to qualify those experts, and I haven't yet seen a good solution to that.
Some heuristics that I use instead:
—Does the expert produce powerful, visible effects in their domain of expertise which non-experts can't duplicate? If so, they're probably reliable within their domain. (For example, engineers can build bridges and authors can make compelling stories, so they're probably reliable in those fields.) This is only useful in cases where a non-expert can evaluate the product's quality; it won't help a non-mathematician evaluate theoretical physics.
—Are the domain experts split into many disagreeing camps? If so, at most one camp is right, which means most of the experts are wrong, and the field isn't reliable. (So this rules out, e.g., experts on nutrition.) This one is a tools for assessing domains of expertise, and won't tell you much about individual experts.
I want to be informed and to act because I have evaluated the evidence, not just go "with the herd." There's a stigma against simply taking the word of an authority, and rightly so; on the net, the world would be better if more people stopped to think for themselves (does anyone disagree?). But it is also the case that there are many fields in which I have to defer to experts because I simply am not equipped to deal with or consider the problems.
I wonder, is it even worth my doing research on charities, when there exist resources like givewell, which will almost certainly be able to do a more thorough and more accurate analysis than I would be able to do? Should I just defer to givewell when giving my effective charity?
I'll note that there is a difference between values and facts: I might decide for myself that I care more about some issues than others, due to variations in my personal moral calculus (for instance, I may value the well being of no-human mammals, relative to human mammals, more than others, and so chose to support animal rights groups, instead of poverty elimination), but might still defer to the experts with regards to how to most efficiently accomplish my stated goals.
Also, do I have good evidence to defer to the expertise of givewell? I like the idea, their analysis seems insightful, and people on this forum often speak highly of them. But these are all relativity superficial and don't seem like sufficient reason to allow them to dictate my giving (that's just lazily, submitting to the slick-looking authority). How do I evaluate the expertise of experts?