The same idea holds for other people's behavior:

I cringe at the thought of stealing from an old lady, but I get flippin' angry at the thought of someone else stealing from an old lady. That is why we punish those who steal from old ladies, but don't (usually) punish any random people who makes us cringe.