Asymmetrical motivation is the problem. If you disagree with a mainstream position, arguing against it feels worth while. If you agree with a fringe position, arguing in favour of it feels worth while. But if you disagree with a fringe position, why bother?
Where the LW "consensus" agrees with the mainstream, then the lack of good contrarians (who would feel their time well spent) is evidence of a sort that the LW "consensus" is true. But such weak evidence is hardly needed.
But where the LW "consensus" is itself the fringe position, we expect that good contrarians would have better things to do than try to set us straight. Thus the lack of good contrarians is both what we expect when a fringe LW "consensus" position is true (which makes it hard to dispute) and when it is false (why bother?). Consequently the lack of good contrarians tells us nothing at all in exactly the case when we look to it for clues.
Good point.
I'm worried that LW doesn't have enough good contrarians and skeptics, people who disagree with us or like to find fault in every idea they see, but do so in a way that is often right and can change our minds when they are. I fear that when contrarians/skeptics join us but aren't "good enough", we tend to drive them away instead of improving them.
For example, I know a couple of people who occasionally had interesting ideas that were contrary to the local LW consensus, but were (or appeared to be) too confident in their ideas, both good and bad. Both people ended up being repeatedly downvoted and left our community a few months after they arrived. This must have happened more often than I have noticed (partly evidenced by the large number of comments/posts now marked as written by [deleted], sometimes with whole threads written entirely by deleted accounts). I feel that this is a waste that we should try to prevent (or at least think about how we might). So here are some ideas: