In the above, I basically offered a theory of the distinction between me doing something to you, versus something just happening to you. The theory focuses on projections of matter and energy. Jiro's reply convinced me that my theory is overly simplistic.

So please, mentally substitute the doing/letting-happen distinction itself, rather than my explanation of it. I realize that consequentialists will deny the importance of the distinction, at least at a fundamental level. My comment above (with this correction) is directed at those who will entertain doubts about consequentialism.