eli_sennesh comments on Proper value learning through indifference - Less Wrong

16 Post author: Stuart_Armstrong 19 June 2014 09:39AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (50)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kaj_Sotala 19 June 2014 03:42:51PM 7 points [-]

An interesting thing to note is that, intuitively, it feels like a lot of humans are indifferent about many of their own values. E.g. people know that their values will probably change as they age, and many (though definitely not all) people just kind of shrug their shoulders about this. They know that their values at age 80 are likely to be quite different than their values at age 18, but their reaction to this thought is neither "yay changing values" nor "oh no how can I prevent this", but rather a "well, that's just the way it is".

Comment author: [deleted] 19 June 2014 07:35:34PM *  2 points [-]

That depends on which of your evaluative judgements we consider to have what levels of noise. If we take a more sophisticated psychological view, it's actually very well-founded that at least some preferences are formed by our biology, and some others are formed by our early-life experiences, and then others are formed by experiences laid down when we've already got the foundations of a personality, and so on. And the "lower layers" are much less prone to change, or at least, to noisy change, to change without some particular life-event behind it.