I don't have answers, but here are a few notes.
For every controversial subject I've heard of, there are always numerous very smart experts on either side.
That's almost a tautology; if all experts were on one side, it wouldn't be controversial.
That said, many controversial subjects either don't have experts, or some sides of the controversy deny the expertise of the other sides. For instance, I don't need to refer to an expert theologist (and they are deep domain experts) to refute a particular religious belief.
There are lots of uncontroversial things I'm unsure about, because I don't trust the consensus-making process in the field. To be unsure of something because it is controversial, the experts and the consensus process has to be explicitly rational and truth-seeking; otherwise what I believe and how sure I am is only weakly correlated with what most 'experts' think on the subject. This rules out religion, politics, philosophy and most policy proposals as interesting controversies, leaving scientific and epistemological questions.
This rules out religion, politics, philosophy and most policy proposals as interesting controversies, leaving scientific and epistemological questions.
Slightly problematic unless you don't admit epistemology being part of philosophy. And it seems like almost as big a swamp as the rest of philosophy, though the problems seem much more worth resolving than in most of philosophy.
There is a paper "Experts: Which ones should you trust" addressing this issue by Alvin Goldman (http://philpapers.org/rec/GOLEWO -- you need JSTOR or something to actual...
For every controversial subject I've heard of, there are always numerous very smart experts on either side. So I'm curious how it is that rational non-experts come to believe one side or the other.
So, what are your meta-arguments for going with one side or the other for any given controversial subject on which you have an opinion?