Mass downvoting would be a legitimate, non-anti-social choice if the votes were counted in a proper Bayesian way, in terms of the evidence they provided. The mass-downvoter's votes would provide no evidence, and so would count for zero.