You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

pragmatist comments on When is Winning not Winning? - Less Wrong Discussion

13 Post author: Eneasz 22 May 2012 04:25PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (60)

You are viewing a single comment's thread. Show more comments above.

Comment author: pragmatist 22 May 2012 10:17:57PM 4 points [-]

Yeah, I see that Future Tuesday Indifference is a bad example. Not precisely for the reason you give, though, because that would also entail that any discounting of future goods is irrational, and that doesn't seem right. But Future Tuesday Indifference would involve the sort of preference switching you see with hyperbolic discounting, which is more obviously irrational and might be confounding intuitions in this case.

So here's a better example: a person only assigns value to the lives of people who were born within a five-mile radius of the Leaning Tower of Pisa. This is an ultimate value, not an instrumental one. There's no obvious incoherence involved here. A person could coherently optimize for this goal. But my point is that this does not exhaust our avenues for rational criticism of goals. The fact that this person has an ultimate value that relies on such a highly specific and arbitrary distinction is grounds for criticism, just as it would be if the person adopted a scientific theory which (despite being empirically adequate) postulated such a distinction.

Comment author: JGWeissman 22 May 2012 10:36:21PM 1 point [-]

Not precisely for the reason you give, though, because that would also entail that any discounting of future goods is irrational, and that doesn't seem right.

Discounting of future goods does not involve assigning different values to the same goods at the same time.

So here's a better example: a person only assigns value to the lives of people who were born within a five-mile radius of the Leaning Tower of Pisa. This is an ultimate value, not an instrumental one. There's no obvious incoherence involved here. A person could coherently optimize for this goal. But my point is that this does not exhaust our avenues for rational criticism of goals. The fact that this person has an ultimate value that relies on such a highly specific and arbitrary distinction is grounds for criticism, just as it would be if the person adopted a scientific theory which (despite being empirically adequate) postulated such a distinction.

I would not criticize this goal for being "irrational", though I would oppose it because it conflicts with my own goals. My opposition is not because it is arbitrary, I am perfectly happy with arbitrariness in goal systems that aligns with my own goals.

Comment author: pragmatist 22 May 2012 10:46:45PM 0 points [-]

Discounting of future goods does not involve assigning different values to the same goods at the same time.

The qualifier "at the same time" is ambiguous here.

If you mean that different values are assigned at the same time, so that the agent has conflicting utilities for a goal at a single time, then you're right that discounting does not involve this. But neither does Future Tuesday Indifference,. so I don't see the relevance.

If "at the same time" is meant to modify "the same goods", so that what you're saying is that discounting does not involve assigning different values to "good-g-at-time-t", then this is false. Depending on the time at which the valuation is made, discounting entails that different values will be assigned to "good-g-at-time-t".

Comment author: JGWeissman 22 May 2012 11:04:12PM *  1 point [-]

If "at the same time" is meant to modify "the same goods", so that what you're saying is that discounting does not involve assigning different values to "good-g-at-time-t", then this is false. Depending on the time at which the valuation is made, discounting entails that different values will be assigned to "good-g-at-time-t".

Suppose an agend with exponential time discounting assigns goods G at a time T a utility of U0(G)*exp(a*(T0-T)). Then that is the utility the agent at any time assigns those goods at that time. You may be thinking that the agent at time TA assigns a utility to the goods G at the same time T of U0(G)*exp(a*(TA-T)) and thus the agent at different times is assigning different utilities, but these utility functions differ only by the constant (over states of the universe) factor exp(a*(TA-T0)), which being an affine transformation, doesn't matter. The discounting agent's equivalency class of utility functions representing its values really is constant over the agent's subjective time.

Comment author: pragmatist 22 May 2012 11:11:08PM *  1 point [-]

Ah, I see. You're right. Comment retracted.