I think we probably agree on 90% of posts that should be down voted but aren't.
Almost certainly and likewise probably more agreement than between randomly selected individuals. The problem comes if any part of that 10% happens to include things that I am strongly averse to but which you consider ok and use. I wouldn't expect you to hang around if I started banning your comments---I certainly wouldn't take that kind of treatment from anyone (unless I was getting paid well).
I never understood people who get all offended and scream censorship if one or two of their posts get moderated while the vast majority are let through. If however you'd feel that a quarter or a third of my comments where objectionable I wouldn't bother commenting any more, though I might keep reading.
If it's worth saying, but not worth its own post, even in Discussion, it goes here.