I'm bad at predicting how my comments get rated, too. However, funny comments seem to get a lot of upvotes.

I suspect most people are voting on the basis of what they do or don't like, but the community has good enough taste that it works out to a useful feedback system-- or maybe it's just a self-reinforcing hall of mirrors which suits my taste.