My possibly stupid question is: "Are some/all of LessWrong's values manufactured?"
Robin Hanson brings up the plasticity of values. Humans exposed to spicy food and social conformity pressures rewire their brain to make the pain pleasurable. The jump from plastic qualia to plastic values is a big one, but it seems plausible. It seems likely that cultural prestige causes people to rewire things like research, studying, etc. as interesting/pleasurable. Perhaps intellectual values and highbrow culture are entirely manufactured values. This seems mildly troubling to me, but it would explain why rationality and logic are so hard to come by. Perhaps the geek to nerd metamorphosis involves a more substantial utility function modification than merely acquiring a taste for something new.
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)
Define manufactured? There isn't really any "default" culture to compare current human values to, for which you could say that "these values are manufactured because they don't manifest in the default culture".
By "manufactured values" I meant artificial values coming from nurture rather than innate human nature. Obviously there are things we give terminal value, and things we give instrumental value. I meant to refer to a subset of our terminal values which we were not born with. That may be a null set, if it is impossible to manufacture artificial values from scratch or from acquired tastes. Even if this is the case, that wouldn't imply that instrumental values could not be constructed from terminal values as we learn about the world. There are 4 possible categories, and I meant only to refer to the last one:
Innate terminal values: “Being generous is innately good, and those who share are good people.” (Note: “generosity admired” is on the list of human universals, so it’s likely to be an innate value we are born with.)
Innate instrumental values: N/A (I don’t think there is anything in this category, because innate human values in babies precede the capacity to reason and develop instrumental values. Maybe certain aesthetic values don’t express themselves until a baby first opens its eyes, and so there could be reasoned instrumental values which are more “innate” than aesthetic values.)
learned instrumental values: “eating spicy food is good to do because it clears your sinuses”
learned terminal values (that is, “manufactured” values): “Bacteria suffering matters, even though I have no emotional connection to them, because of these abstract notions of fairness.” Or, alternatively “Eating spicy food is a pure, virtuous activity in its own right rather than for some other reason. Those who partake are thus good people, and those who don’t are unclean and subhuman.” The former is merely extrapolated from existing values and dubbed a terminal value, while the latter arises from an artificially conditioned aesthetic.
To use a more LW-central example, those of us who favor epistemic rationality over instrumental rationality do so because true knowledge is a terminal value for us. If this value is a human universal, then that would be strong evidence that every neurotypical baby is born valuing truth, and therefore that truth-seeking is a terminal value. If only a few cultures value truth, then it would seem more plausible that truth-seeking was a manufactured terminal value or an instrumental value.
To test ideas like this, we can look at the terms on the list related to epistemic rationality: abstraction in speech & thought, classification, conjectural reasoning, interpolation, logical notions [there are several examples on the list], measuring, numerals (counting), overestimating objectivity of thought, semantics [several semantic categories are also on the list], true and false distinguished. So, either all cultures get a lot of value out of instrumental truth-seeking, or truth-seeking is an innate human value. Judging by the curiosity of children, I’m strongly inclined toward the latter. Perhaps LW users have refined and accentuated their innate human curiosity, but it certainly doesn’t seem like a manufactured value.
But it looks like you guys forced me to make my question specific enough that I could answer it empirically. I could just take each item on the list of the twelve virtues of rationality, or any other list I thought gave a good representation of LW values or intellectual values. Just cross-reference them against a couple lists of human universals and lists of traits of small children. If very small children display a value, it’s probably innate, but may be learned very early. If no infants have it but some/all adults do, it’s probably a learned value developed later in life. If it seems like it is probably a learned value, and seems subjectively to be a terminal value, then it is manufactured.
Also, to be clear, just because something is manufactured doesn’t make it a bad thing. To say so is to commit the naturalistic fallacy. However, altering one’s utility function is scary. If we are going to replace our natural impulses with more refined values, we should do so carefully. Things like the trolley problem arguably segregate people who have replaced their default values with more abstract utilitarian notions (value all lives equally, regardless of in-group or a sense of duty). Extrapolating new values from existing ones doesn’t seem as dangerous as deriving them from acquired tastes.