he's actively trying to drive away people for disagreeing with his politics
No, I don't think so.
In the context of online debates, "actively trying to drive away" means things like threats, discussion of sexual inadequacies, and expressed desires for someone to die in a fire. That is not the case here.
And people who are that sensitive to their karma score are unlikely to be comfortable in LW anyway.
"Actively trying to drive people away" means doing something with the intention of trying to drive someone away. That could mean screaming at them, overusing the word 'moist', or agreeing with them when they want an argument. It could also mean downvotes. It may be hard to judge if someone is trying to drive someone away, but defaulting to "they are not openly being abusive blowhards" is not really useful unless the only thing you care about is abusive blowhards.
However, I would argue that "actively trying to drive people away" is less important that "driving away productive contributors".
Another month, another rationality quotes thread. The rules are: