Carl_Shulman comments on The Bedrock of Morality: Arbitrary? - Less Wrong

16 Post author: Eliezer_Yudkowsky 14 August 2008 10:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (113)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Carl_Shulman 15 August 2008 02:14:03AM 0 points [-]

Roko,

"UIVs are the unique set of values X such that in order to achieve any other value Y, you first have to do X." Roko,

You know that all of the so-called 'UIVs' that have been postulated only apply for some Y under some conditions (the presence of other powerful agents and game theoretic considerations or manipulation, self-referential utility functions, preferences over mathematical truths, and many other considerations make so-called UIVs useless or sources of terminal disvalue for an infinite number of cases), and an agent could have the terminal value Y1, where Y1 is not valuing anything in X, so X is an empty set.

Why are 'often instrumental values,' or OIVs, non-arbitrary terminal values as well?