If it's worth saying, but not worth its own post, then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should start on Monday, and end on Sunday.
4. Unflag the two options "Notify me of new top level comments on this article" and "
It's a central notion in the computational metaethics that, not under that name, was tentatively sketched by Yudkowski in the metaethics sequence.
Humans share, because of evolution, a kernel of values that works as a foundation of what we call "morality". Morality is thus both objective and subjective: objective because these values are shared and encoded in the DNA (some are even mathematical equilibria, such as cooperation in IPD); subjective because since they are computation they exists only insofar our minds compute them, and outside of the common nucleus they can vary depending on the culture / life experiences / contingencies / etc.
Thanks you for pointing me to the articles. So much material!
This is were I believe the rational analysis has gone wrong. When you say computation I understand it in one of two ways:
[1] This is clearly not the case as even today we are trying to find a computational basis for morality. But we already have advanced system of values so they have been created before this attempt of ours... (read more)