blacktrance comments on Tell Culture - Less Wrong

109 Post author: BrienneYudkowsky 18 January 2014 08:13PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (217)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 31 January 2014 09:48:44PM *  2 points [-]

It seems to me that Tell culture is unstable: if there is no social cost for stating strong preferences, people will be incentivized to overstate their preferences, and it will de facto reduce to Ask culture.

This is false. This reduction only occurs if you also assume that the agents are also compelled to do some degree of sloppy utilitarian aggregation.

Stating strong preferences doesn't compel people to give you more stuff. It tells people that to whatever extent they wish to give you stuff, which kind of stuff you would prefer to have.

Consider Bob:

  • Bob values being given a chocolate cake 9.
  • Bob values a foot massage 2.
  • Bob values being given a beer 1.

Bob could lie and say:

  • I value being given a chocolate cake OVER 9000!.
  • I value a foot massage OVER 9000!.
  • I value being given a beer OVER 9000!.

Consider Alice:

  • Alice giving a chocolate cake costs 4.
  • Alice giving a foot massage to Bob costs 3.
  • Alice giving a beer costs 2.
  • Alice wishes to spend 5 on Bob (either in trade or out of altruism) and to do so in the most effective way.

Since Bob has overstated Alice concludes that giving a foot massage and a beer will give Bob OVER 18,000! value while giving Bob a chocolate cake will give Bob a mere OVER 9,000! value.

If Bob had stated his preferences accurately then Alice would have given him the cake and he would have got his 9 value. He lied, so he got a mere 3 value. That was silly of him.

It isn't Tell Culture that makes Bob's communication devolve to Ask culture. Bob being bad at decision theory makes him devolve to Ask Culture. Alice should go hang out with Jack, who is less of an ineffectively-demanding-jackass.

Comment author: blacktrance 31 January 2014 09:57:38PM 0 points [-]

But people do make a sort-of utilitarian calculation about what to give to whom. If your friend Xerxes says he values chocolate cake at OVER 9000!!! and your friend Ygnacio says he values it at 1, you care about both of them roughly equally, and you assume that they're stating their preferences honestly, you should give the cake to Xerxes. But then there's an incentive to exaggerate one's preferences.

Comment author: wedrifid 01 February 2014 01:34:08AM -1 points [-]

But people do make a sort-of utilitarian calculation about what to give to whom.

No, they really don't. Most significantly because most people don't behave as consequentialists of any kind. Also, and this time fortunately, our egalitarian instincts are sufficient to suppress that kind of folly.

If your friend Xerxes says he values chocolate cake at OVER 9000!!! and your friend Ygnacio says he values it at 1, you care about both of them roughly equally, and you assume that they're stating their preferences honestly, you should give the cake to Xerxes.

No, you shouldn't. Even if we ignore the type error of comparing Xerxes_value and Ygnacio_value and your decision 'should' take into account other information including things like who you gave the strawberry tarts to ten minutes ago and assorted other social transactions. I have not met a single human who gives all his favours to the same person because they are the most enthusiastic (and would consider the resultant behaviour to be repugnant and a behavioural red flag).

But then there's an incentive to exaggerate one's preferences.

Yes, as the grandparent observed, when the people being spoken to are both gullible and utilitarian and the speakers are neither ethical nor utilitarian 'Tell' does devolve into 'Ask'. However if the listener is either not-gullible or not a crude total utilitarian then exaggerating your preferences amounts to crippling your own ability to receive value via either trade or gifts towards the limit of being only able to communicate booleans. (ie. It's purely destructive self-sabotage.)

Comment author: blacktrance 01 February 2014 03:15:13AM *  3 points [-]

No, they really don't. Most significantly because most people don't behave as consequentialists of any kind.

Most people don't consistently behave as consequentialists, but they do make consequentialist decisions some of the time, particularly in cases like this one. Consider a less extreme example. Suppose your friend Xerxes is obsessed with Beethoven - he listens to every known composition and tries to learn it, and derives great enjoyment from doing so. Your friend Ygnacio also likes classical music in general but has no specific fondness for Beethoven. While digging in your belongings, you discover a sheet of antique sheet music personally written by Beethoven. Coincidentally, Xerxes's and Ygnacio's birthdays are coming up, and this would make a good gift for either of them - but as there's only one sheet of music, only one of them can receive it. Certainly, Ygnacio would appreciate it, but Xerxes would like it much more. In such a situation, most people would give the sheet music to Xerxes, because he would enjoy it more. As for the utility monster, that's a nonsequitur in this context, because we're not talking about true (agent-neutral) utilitarianism, only about utility maximization, which is not the same thing.

Even if we ignore the type error of comparing XerxesValue and YgnacioValue

We're not comparing XerxesValue and YgnacioValue, we're comparing HowMuchYouCareAboutXerxes x XerxesValue and HowMuchYouCareAboutYgnacio x YgnacioValue, which does not produce a type error.

your decision 'should' take into account other information including things like who you gave the strawberry tarts to ten minutes ago and assorted other social transactions

If you gave the strawberry tarts to someone ten minutes ago, it is reasonable to assume that because of diminishing marginal utility, they won't value sweets as highly as they did before. But if you have reason to believe that they don't experience diminishing marginal utility, or that their diminished derived utility would still be greater than the utility derived by an alternative person, then you should give it to the person who would derive greater utility (assuming you value them equally). It's true that people don't always give all favors to the most enthusiastic person, but that is justified because it's reasonable to assume that enthusiasm isn't always a reliable indication of derived value.

(Had to edit this a million times, markup hates me.)

Comment author: hyporational 01 February 2014 04:34:09AM 0 points [-]

But if you have reason to believe that they don't experience diminishing marginal utility, or that their diminished derived utility would still be greater than the utility derived by an alternative person, then you should give it to the person who would derive greater utility (assuming you value them equally).

How do you think caring about having more allies than one affects this situation?

Comment author: blacktrance 01 February 2014 04:44:44AM -2 points [-]

If that's a term in your utility function, then you should consider it. Here, I'm assuming there aren't any other effects.