It's worth noting that the values folks are programmed to "bargain" with may be unendorsed leftovers from evolution.

Good point. A good reason to be less biased even if that's not "instrumentally rational" is that your biases may only be rational for a set of values that aren't actually yours in an important sense.