How do you come to that conclusion? Simply because you don't agree with their actions?

Uhm, no. Allow me to quote from my other comment:

If I tried to estimate a sociopathy scale from 0 to 10, in my life I have personally met one person who scores 10, two people somewhere around 2, and most nasty people were somewhere between 0 and 1, usually closer to 0.

I hope it illustrates that my mental model has separate buckets for "people I suspect to be sociopaths" and "people I disagree with".