I've also recently experienced a 100 point drop in total karma, between one night and the next morning, and my comments are not usually nearly that controversial. I have enough karma, and enough experience to get used to occasional downvotes, that it's not a major source of distress, but I would not be surprised if mass-downvoting is becoming more common.