Benja comments on Continuity axiom of vNM - Less Wrong

3 Post author: Stuart_Armstrong 30 July 2014 04:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (13)

You are viewing a single comment's thread.

Comment author: Benja 30 July 2014 08:54:34PM 7 points [-]

I don't follow. Could you make this example more formal, giving a set of outcomes, a set of lotteries over these outcomes, and a preference relation on these that corresponds to "I will act so that, at some point, there will have been a chance of me becoming a heavy-weight champion of the world", and which fails Continuity but satisfies all other VNM axioms? (Intuitively this sounds more like it's violating Independence, but I may well be misunderstanding what you're trying to do since I don't know how to do the above formalization of your argument.)

Comment author: Stuart_Armstrong 31 July 2014 09:12:57AM *  2 points [-]

Take a reasoner who can make pre-commitments (or a UDT/TDT type). This reasoner, in effect, only has to make a single decision for all time.

Let A, B, C... be pure outcomes, a, b, c,... be lotteries. Then define the following pseudo-utility function f:

f(a) = 1 if the outcome A appears with non-zero probability in a, f(a) = 0 otherwise. The decision maker will use f to rank options.

This clearly satisfies completeness and transitivity (because it uses a numerical scale). And then... It gets tricky. I've seen independence written both in a < form and a <= form (see http://en.wikipedia.org/wiki/Expected_utility_hypothesis vs http://en.wikipedia.org/wiki/Von_Neumann%E2%80%93Morgenstern_utility_theorem ). I have a strong hunch that the two versions are equivalent, given the other axioms.

Anyway, the above decision process satisfies <= independence (but not < independence).

To see that the decision process satisfies <= independence, note that f(pa+(1-p)b)=max(f(a),f(b)). So if f(a) <= f(b), then f(pa+(1-p)c)=max(f(a),f(c)) <= max(f(b),f(c)) = f(pb+(1-p)c)).

Comment author: owencb 31 July 2014 10:12:26AM 3 points [-]

Yes, the two versions of independence are equivalent given the other axioms. If you don't have continuity to make them equivalent, I think the natural thing to do is to ask for both types of independence.

(The intuition is: independence feels like it should demand all of these things. Normally it's not stated like that because it's clunky to add extra statements when one is enough.)

Comment author: Stuart_Armstrong 31 July 2014 12:24:17PM *  3 points [-]

So if we ditch continuity, do the two independence axioms ensure we have utility functions (possibly non-standard ones)?

Comment author: owencb 31 July 2014 01:24:25PM 3 points [-]

I find it quite plausible that would ensure this (60-80% credence?), but it's not obvious. In particular the way you normally prove that there's a utility function is that you construct it, and you use the continuity axiom to do this.

Without the continuity axiom, maybe you can prove some representation with something satisfying the axioms for the reals ... but it looks hard.

Comment author: Stuart_Armstrong 31 July 2014 03:18:30PM *  2 points [-]

At the very minimum, you need to have a distributivity law for lotteries. If 50%(50%A+50%B)+50%(50%A+50%C) is not defined to be the same thing as 50%A+25%B+25%C, then it's easy to find counter-examples...

Comment author: owencb 31 July 2014 03:26:50PM 2 points [-]

Yes, I think in the classical conception of lotteries these are regarded as the same. You could reject that, but it seems like it would be similar to how some people think that (A, when B was on the table) is a different outcome from (A, when B was not on the table), and so may be assigned a different utility.

Comment author: Stuart_Armstrong 31 July 2014 01:37:51PM *  2 points [-]

I'll try building counter-examples first, then...

Comment author: Stuart_Armstrong 01 August 2014 02:25:55PM 1 point [-]

It seems that you do have that result, see here: http://link.springer.com/article/10.1007%2FBF01766393

However this seems to require a strengthening of the independence axiom, so that the implication goes in the opposite direction in some cases (see axiom 6, page 71).

Comment author: Stuart_Armstrong 01 August 2014 07:19:33AM *  1 point [-]

incidentally, < independence isn't enough on its own either.

Pick a standard expected utility situation, with A<B for two pure outcomes A and B. Then arbitrarily set A=B.

< Independence is of the type "if smeu then blah". A=B is not a smeu, and will never appear as a blah.

EDIT: this violates transitivity, alas.