I'm afraid I'll butcher the explanation and hurt the meme, so I'll say it's mostly about other programs, not your own. E.g. like how do we differentiate between the preferences of an agent and just things in its environment after it's gone and interacted with its local environment a lot, e.g. Odysseus and his ship. (These are just cached ideas without any context in my mind, I didn't generate these concerns myself.)