I think votes tend to get more petty use than might be preferred, the negative effects of which could be partly ameliorated by displaying upvotes and downvotes separately, but even in the absence of that feature I think they do more good than harm.