Caspian comments on Gains from trade: Slug versus Galaxy - how much would I give up to control you? - Less Wrong

33 Post author: Stuart_Armstrong 23 July 2013 07:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (67)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 20 July 2013 07:00:58PM *  3 points [-]

Why? If you can end up on either end of a long line segment, then you have a chance of winning a lot or losing a lot. But you shouldn't be risk averse with your utility - risk aversion should already be included. So "towards the middle" is no better in expectation than "right end or left end".

Maybe you're thinking we shouldn't be maximising expected utility? I'm actually quite sympathetic to that view...

And with complex real world valuations (eg anything with a diminishing marginal utility), then any Pareto line segments are likely to be short.

Comment author: Caspian 20 July 2013 10:15:21PM 3 points [-]

Nonlinear utility functions (as a function of resources) do not accurately model human risk aversion. That could imply that we should either change our (or they/their) risk aversion or not be maximising expected utility.

Comment author: Zvi 21 July 2013 12:05:01AM 6 points [-]

Nonlinear jumps in utility from different amounts of a resource seem common for humans at least at some points in time. Example: Either I have enough to pay off the loan shark, or he'll break my legs.

Comment author: Stuart_Armstrong 21 July 2013 06:48:26AM 0 points [-]

Yep. Humans are not expected utility maximisers. But there's strong arguments that an AI would be...