My favorite other idea is charge downvoters one karma point for each downvote as is done stackexchange.

I was actually surprised that (down)voting doesn't cost karma. But doing so creates an imbalance and I now see it as beneficial. It is more the policity followed by voting that is the problem.