[...] I find I often only care enough about ~2 comments out of 10 to upvote or downvote them, which implies that the majority of comments on LW are ones I don't have even a mild opinion about.

I'm confused. I thought the voting system ostensibly represents quality of reason, not concurrence of values or opinions.