General ughy feelings around doing anything related to downvote investigations and an unwillingness to do anything that would cause me to spend more time doing them. Possible reasons for those ughy feelings include an aversion to doing anything confrontational (including punishing mass downvoters), a high uncertainty of what should be considered unacceptable behavior and low confidence in my ability to accurately determine what counts as karmassassination, and an unwillingness to bother people (including jackk) unless absolutely necessary. Not all of those reasons necessarily applied in your case, but it was close enough to trigger the emotional association.

I'm going to go out on a limb and guess that the persons who downvoted me a lot have significantly more popular views than those of Eugine_Nier.