I think I may not have gotten the point I was trying to make across - I don't think all harm is of the form "violation of property rights", I think the reason "property rights" are a thing we care about is because their violation is harmful.

Would you permit a market in infants?

An interesting question, but not one I've thought about. If what I've said above is tells you what you want to know, I'm not going to try discussing this here. Otherwise I will.