M as an isomorphism is just an interpretation between things (rocks, birds, etc.) and "math things" (numbers, etc.) Its physical referent is the human mental instantiation of that interpretation (e.g., in the form of neutro transmitters or what have you.) However, (see my comment a little above), I don't think this is what you were getting at.