I have varying levels of empathy for different classes of beings (for example: my family and neighbours > people that live in a faraway and different country > my mother's cat > murderers and rapists > cows > insects > telemarketers who call during dinner to sell insurance > plants > rocks). The ordering seems to roughly correspond both to "things who are likely to be nicer towards me if I'm nicer towards them" and "genetic relatedness", both of which probably account for the evolution of our current morals in the first place.

Of course, "our morals evolved in order to fulfill goal X" doesn't mean that we should try to fulfill goal X instead of following our morals. But it explains why our moral intuitions generally have weird patterns. It' not clear to me whether that means our intuitions are something wrong, or that we should be cautious about coming up with simple rules to explain our morality.

My current position is to acknowledge that I care less about some entities than others, and that while some moral systems say that I shouldn't, those systems go against my intuitions, so it's not clear which of my intuitions or the moral systems are wrong - the fact that ultimately, moral systems aren't justified by anything much stronger than intuitions (and possibly something like game theory) is enough for me to stick to my badly-formalized intuitions for now.