How about the alternative of showing the name if greater than X percent of the user's last Y comments have been voted down by the same person? If you downvote 98 of a user's last 100 comments and they're not a blatant troll, you probably deserve to earn their wrath, influential or not.

If you don't want to do even that, then how about this instead: for each comment that was modded down, have a button to click for "moderation statistics". If you click on the button it will say something like "This comment was modded down by 2 users. User 1 has modded down 4 of your past 100 posts. User 2 has modded down 99 of your past 100 posts". Suspicious numbers like 99 out of 100 can be grounds for contacting an admin. There's nothing like having an actual human being doing actual adminning. This solution would also prevent someone from gaming the system by noticing that a name is displayed at 95% so he only mods down 94% of someone's posts.