Furslid comments on We Don't Have a Utility Function - Less Wrong

43 [deleted] 02 April 2013 03:49AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (123)

You are viewing a single comment's thread. Show more comments above.

Comment author: Furslid 03 April 2013 05:54:18PM 0 points [-]

The difference between instrumental and terminal values are in the perception of the evaluator. If they believe that something is useful to achieve other values, then it is an instrumental value. If they are wrong about its usefulness, that makes it an error in evaluation, not a terminal value. The difference between instrumental and terminal values is in the map, not in the territory. For someone who believes in astrology, getting their horoscope done is an instrumental value.

Comment author: Eugine_Nier 04 April 2013 07:56:36AM *  1 point [-]

The difference between instrumental and terminal values are in the perception of the evaluator.

In practice this criterion is frequently circular. See also the blue minimizing robot.