It's generally a better idea to criticize actions rather than people: question your actions before you question yourself (the latter leads to a mindset which is more resistant to changing actions). But in any case, the most likely hypothesis, given that many of your posts have only one downvote, is that someone is serially downvoting you.