Grognor comments on Stupid Questions Open Thread Round 3 - Less Wrong

8 Post author: OpenThreadGuy 07 July 2012 05:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (208)

You are viewing a single comment's thread.

Comment author: Grognor 24 July 2012 12:57:53AM *  3 points [-]

Could someone please explain to me exactly, precisely, what a utility function is? I have seen it called a perfectly well-defined mathematical object as well as not-vague, but as far as I can tell, no one has ever explained what one is, ever.

The words "positive affine transformation" have been used, but they fly over my head. So the For Dummies version, please.

Comment author: VincentYu 24 July 2012 04:44:49AM *  4 points [-]

Given an agent with some set X of choices, a utility function u maps from the set X to the real numbers R. The mapping is such that the agent prefers x1 to x2 if and only if u(x1) > u(x2). This completes the definition of an ordinal utility function.

A cardinal utility function satisfies additional conditions which allow easy consideration of probabilities. One way to state these conditions is that probabilities defined on X are required to be linear over u. This means that we can now consider probabilistic mixes of choices from X (with probabilities summing to 1). For example, one valid mix would be 0.25 probability of x1 with 0.75 probability of x2, and a second valid mix would be 0.8 probability of x3 with 0.2 probability of x4. A cardinal utility function must satisfy the condition that the agent prefers the first mix to the second mix if and only if 0.25u(x1) + 0.75u(x2) > 0.8u(x3) + 0.2u(x4).

Cardinal utility functions can also be formalized in other ways. E.g., another way to put it is that the relative differences between utilities must be meaningful. For instance, if u(x1) - u(x2) > u(x3) - u(x4), then the agent prefers x1 to x2 more than it prefers x3 to x4. (This property need not hold for ordinal utility functions.)

Other notes:

  • In my experience, ordinal utility functions are normally found in economics, whereas cardinal utility functions are found in game theory (where they are essential for any discussion of mixed strategies). Most, if not all, discussions on LW use cardinal utility functions.

  • The VNM theorem is an incredibly important result on cardinal utility functions. Basically, it shows that any agent satisfying a few basic axioms of 'rationality' has a cardinal utility function. (However, we know that humans don't satisfy these axioms. To model human behavior, one should instead use the descriptive prospect theory.)

  • Beware of erroneous straw characterizations of utility functions (recent example). Remember the VNM theorem—very frugal assumptions are sufficient to show the existence of a cardinal utility function. In a sense, this means that utility functions can model any set of preferences that are not logically contradictory.

  • Ordinal utility functions are equivalent up to strictly increasing transformations, whereas cardinal utility functions are equivalent only up to positive affine transformations.

  • Utility functions are often called payoff functions in game theory.

Comment author: [deleted] 24 July 2012 01:31:01AM 1 point [-]
Comment author: shminux 24 July 2012 01:34:16AM 1 point [-]

Wiktionary seems to have a decent definition. It boils down to listing all possible outcomes and ordering them according to your preferences. The words "affine transformation" reflect the fact that all possible ways to assign numbers to outcomes which result in the same ordering are equivalent.