Vladimir_Nesov comments on Complexity of Value ≠ Complexity of Outcome - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (198)
Not "bunch of conditions". Reflective consistency is the same concept as "correctly copying preference", if I read your sense of "copying" correctly, and given that preference is not just "thing to be copied", but also plays the appropriate role in decision-making (wording in the grandparent comment improved). And reflectively consistent agents are taken as a natural and desirable (from the point of view of those agents) attractor where all agents tend to end up, so it's not just an arbitrary category of agents.
But there are many different preferences for different agents, just as there are different genes. Using the word "genes" in the context where both human preference and evolution are salient is misleading, because human genes, even if we take them as corresponding to a certain preference, don't reflect human preference, and are not copied in the same sense human preference is copied. Human genes are exactly the thing that currently persists by vanilla "copying", not by any reversible (mutual information-preserving) process.
Confusing terminology is still bad even if you failed to think up a better alternative.