HonoreDB comments on In the Pareto world, liars prosper - Less Wrong

15 Post author: Stuart_Armstrong 08 December 2011 02:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (33)

You are viewing a single comment's thread.

Comment author: HonoreDB 08 December 2011 06:11:50PM *  0 points [-]

Interesting!

"Wave" should be "waive" in the last line.

Retracted:

More substantively, I don't think I believe this claim:

Now, the new outcome must be on the green segment somewhere (including the end points). Or else, as we have seen, player y will have profited by lying.

Player y would gain .95 utility by being honest. Most of the blue segment is below y=.95.

Edit: I could easily be missing something, but I think this invalidates the proof. Your statement about the blue line in diagram 1 does not hold for diagram 2, but your conclusion depends on it. The outcome (.5,.6) doesn't break any of your rules, but doesn't reward liars.

Comment author: Stuart_Armstrong 08 December 2011 06:29:36PM 2 points [-]

Remember that player y is lying: the blue segment lies below y=0.95, but only for the fake values that y is claiming. In actual fact, that blue line is always above 0.95 (you can see this on the first diagram).

Comment author: HonoreDB 08 December 2011 06:37:22PM 0 points [-]

Possibly my confusion lies in the way values are being re-normalized after player y lies.

In diagram 2, consider the outcome (.5,.6). Even if we re-normalize that outcome by multiplying by the sum of y's real utilities and dividing by the sum of y's fake utilities, .6 * (3.1 / 2.55) =~ .73, well below the default outcome of .95. Am I doing that wrong?

Comment author: Stuart_Armstrong 08 December 2011 07:16:40PM 2 points [-]

There's no need to renormalise: any outcome on the blue line is a probabilistic mixture between the (0,1) and (0.95,0.95) choices (to use the genuine utilities of these outcomes). This is better for y than the pure (0.95,0.95) option.

Comment author: HonoreDB 08 December 2011 07:58:35PM 1 point [-]

Oh, I see. That's why the straight lines are significant: they show that no mixture involving the (.6,.6) point is optimal. Thanks for explaining.