To identify how human values are different from values of pure instrumental power and self-preservation, look at the system that produced those values.

OK...

Humans are considerate of the rights of others because we are social animals - if we cannot negotiate our way to a fair share in a balanced power system, we are lost.

So: a selfish agent would behave that way too. This example seems unsuccessful.

Humans embrace openness because shared intellectual product is possible for us - we have language and communicate with our peers.

That is valuable for us, though. It is true that it is also valuable for our memes. They want us to communicate - so they can spread and become more powerful.

Humans have direct concern for the welfare of (at least some) others because we reproduce and are mortal - our children are the only channel for the immortalization of our values.

That helps humans to signal what nice creatures they are to each other - and being nice is attractive. Surely a selfish agent would behave in the same way.

And we have some fundamental respect for diversity of values because we reproduce sexually - our children do not exactly share our values, and we have to be satisfied with that because that is all we can get.

Diversity really is helpful in many cases. Diversity helps protect against disease. A diverse population can adapt better if the environment changes - and so on.

I am not sure you made your case here. IMO, human values differ from those of a selfish, limited agent mainly because humans have their brains infected by memes. That skews human values in favour of chatter, gossip, fashion, religion - the things that benefit the memes.