If Starbucks lattes (or more obviously living above the subsistence level) makes it more likely for me to maintain my strategy of earning money to try to protect the things I value, my indulgences are very plausibly worth keeping. Yes, if I had another psychology I could skip that and help much more, but I don't, so I likely can't.

That gives you an incentive to not try to change your psychology, or even see if it's possible to change. If seeing your psychology as immutable gives you a reason to get what you want, you'll be biased against seeing it any other way. It's perfectly fine to choose Starbucks lattes over strangers' lives, lest we end up like Zachary Baumkletterer, but let's at least be honest about our preferences.