Perhaps you could disable downvoting functionality for those with a karma ratio lower than 75% or 80%?

"Please provide proof of your complete integration with the hive-mind before being allowed near the downvote button" X-D

Lumifer, your karma ratio is 80%.