But does that argument really track with your intuitions?

At one point I would have said "yes", but at this point I've basically given up on trying to come up with verbal arguments that would track my intuitions, at least once we move away from clear-cut cases like "Skyrim NPCs suffering from my fireballs would be bad" and into messier ones like a multiplayer game.

(So why did I include the latter part of my comment in the first place? Out of habit, I guess. And because I know that there are some people - including my past self - who would have rejected your argument, but whose exact chain of reasoning I no longer feel like trying to duplicate.)