What I was getting at is that humans have mostly symmetric values such that they should not disagree over what type of society they want to live in, if they don't get to choose the good end of the stick.

This seems wrong, except for extremely weak definitions of "mostly". People should definitely disagree about what type of society they want to live in, just a whole lot less than if they were disagreeing with something non-human.