You know, Eliezer, I've seen you come up with lots of interesting analogies (like pebblesorters) to explain you concept of morality. Another one occurred to me that you might find useful: music. It seems to have the same "conflict" between reductionist "acoustic vibrations" vs. Beethoven, as morality. Not to mention the question of what aliens or AIs might consider to be music. Or, for that matter, the fact that there are someone different kinds of music in different human cultures, yet all sharing some elements but not necessarily others.

And, in the end, there is no simple rule you can define, which distinguishes "music" vibrations from "non-music" vibrations.

Well, probably you don't need more suggestions. But I thought the "music ~= morality" connection was at least interesting enough to consider.