A side note to your otherwise excellent comment:

"we only care about the 'good' people (women, black, trans, etc.)"

As someone from the other side of the fence, I should warn you that your model of how liberals think about social justice seems to be subtly but significantly flawed. My experience is that virtually no liberals talk or (as far as I can tell) think in terms of "good" vs. "bad" people, or more generally in terms of people's intrinsic moral worth. A more accurate model would probably be something like "we should only be helping the standard 'oppressed' people (women, black, trans, etc.)". The main difference being that real liberals are far more likely to think in terms of combating social forces than in terms of rewarding people based on their merit.