Median-based, stars-out-of-five voting might encourage downvoting, because you can make it clear with your vote that you're saying "not all that great" rather than "terrible, should be burned".

Still, there's a separate exercise in persuading people that thinking "this comment is just trash" doesn't necessarily mean you're hopelessly in the grip of confirmation bias. This probably deserves a top-level post of its own.