Given that we're heading towards morality and the Singularity, I imagine this is here as a dependency for a future post arguing that there is a more-or-less objective notion of morality/humaneness/Friendliness for humans. However, even though all humans are virtually alike compared to the vastness of possible mind design space, there is still, from a human perspective, an enormous amount of variation amongst people. The things that everyone has in common are ipso facto irrelevant: it would border on contradiction to tell a human that her moral stance is wrong because it is contrary to human nature, for if it really were, a human couldn't hold it.

Something to address in a future post, perhaps.