dlthomas comments on Morality is not about willpower - Less Wrong

9 Post author: PhilGoetz 08 October 2011 01:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (144)

You are viewing a single comment's thread. Show more comments above.

Comment author: dlthomas 29 October 2011 08:05:07PM 0 points [-]

You are being frustrating.

Your citations here are talking about trying to model human behavior based on trying to fit concave functions of networth-to-utility to realistic numbers. The bit you quoted here was from a passage wherein I was ceding this precise point.

I was explaining that I had previously thought you to be making a broader theoretical point, about any sort of risk premia - not just those that actually model real human behavior. Your quoting of that passage lead me to believe that was the case, but your response here leads me to wonder whether there is still confusion.

If you try to reuse this utility curve for any other bet or bet with more than two outcomes, you'll start seeing the same person accepting infinite, near-zero, or even negative risk premia.

Do you mean this to apply to any theoretical utility-to-dollars function, even those that do not well model people?

If so, can you please give an example of infinite or negative risk premia for an agent (an AI, say) whose dollars-to-utility function is U(x) = x / log(x + 10).

Comment author: taw 30 October 2011 09:37:16PM 0 points [-]

This utility function has near zero risk aversion at relevant range.

Assuming our AI has wealth level of $10000, it will happily take a 50:50 bet of gaining $100.10 vs losing $100.00.

It also gets to infinities if there's a risk of dollar worth below -$10.

Comment author: dlthomas 30 October 2011 10:24:35PM 0 points [-]

This utility function has near zero risk aversion at relevant range.

Assuming our AI has wealth level of $10000, it will happily take a 50:50 bet of gaining $100.10 vs losing $100.00.

Yes, it is weak risk aversion - but is it not still risk aversion, as I had initially meant (and initially thought you to mean)?

It also gets to infinities if there's a risk of dollar worth below -$10.

Yes, of course. I'd considered this irrelevant for reasons I can't quite recall, but it is trivially fixed; is there a problem with U(x) = x/log(x+10)?