Yeah, that sounds like a much better solution than what we've got. Your workaround should also work -- and would be made a bit more safe by applying the reversible vote trick, though that's a borderline exploit -- but I wouldn't be surprised to find other issues; the different parts of the karma system here don't always synchronize perfectly.