Crux comments on Don't Get Offended - LessWrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (588)
That's not what "terminal values" means. It simply means the values from which all of a person's other values can be derived. It is perfectly possible to change one's terminal values -- for instance, a young child cares only about itself, while almost no adults care only about themselves.
That's a good point. Another example is going through puberty. Although one could imagine an AI whose terminal values are always the same, and thus make changes to their behavior only due to acquiring new knowledge, it seems that humans are literally built for their terminal values to shift in particular ways.