I agree with what you're saying. The way I like to frame it is that I have expectations that people behave with a minimum of politeness towards me. I don't so much bother with considering other parts of the universe to 'owe me something' since that is futile. Instead I consider my social boundaries to be part of myself and something I am responsible for enforcing for no other reason than because I want to.