PhilGoetz comments on Average utilitarianism must be correct? - Less Wrong

2 Post author: PhilGoetz 06 April 2009 05:10PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (159)

You are viewing a single comment's thread. Show more comments above.

Comment author: PhilGoetz 08 April 2009 04:11:49AM *  -2 points [-]

Expected utility is based on epistemic uncertainty

What? So if you had accurate information about the probability distribution of outcomes, then you couldn't use expected utility? I don't think that's right. <EDIT> In fact, it's exactly the reverse. Expected utility doesn't really work when you have epistemic uncertainty. </EDIT>

Comment author: Nick_Tarleton 08 April 2009 01:44:38PM 1 point [-]

What does "accurate information about the probability distribution" mean? Probability is in the mind.

If I'm using subjective probabilities at all – if I don't know the exact outcome – I'm working under uncertainty and using expected utility. If, in a multiverse, I know with certainty the objective frequency distribution of single-world outcomes, then yes, I just pick the action with the highest utility.

Comment author: Vladimir_Nesov 08 April 2009 03:22:45PM 1 point [-]

If, in a multiverse, I know with certainty the objective frequency distribution of single-world outcomes, then yes, I just pick the action with the highest utility.

You still need to multiply utility of those events by their probability. Objective frequency is not as objective as it may seem, it's just a point at which the posterior is no longer expected to change, given more information. Or, alternatively, it's "physical probability", a parameter in your model that has nothing to do with subjective probability and expected utility maximization, and has the status similar to that of, say, mass.

Comment author: steven0461 08 April 2009 04:39:08PM *  1 point [-]

I don't know that this affects your point, but I think we can make good sense of objective probabilities as being something else than either subjective probabilities or objective frequencies. See for example this.

Comment author: PhilGoetz 08 April 2009 03:28:51PM *  -1 points [-]

You said

Expected utility is based on epistemic uncertainty, which has nothing to do with objective frequency

If you have accurate information about the probability distribution, you don't have epistemic uncertainty.

What was you original comment supposed to mean?

If, in a multiverse, I know with certainty the objective frequency distribution of single-world outcomes, then yes, I just pick the action with the highest utility.

This is the situation which the theory of expected utility was designed for. I think your claim is exactly backwards of what it should be.

Comment author: Vladimir_Nesov 08 April 2009 04:24:13PM *  2 points [-]

If you have accurate information about the probability distribution, you don't have epistemic uncertainty.

This is not what is meant by epistemic uncertainty. In a framework of Bayesian probability theory, you start with a fixed, exactly defined prior distribution. The uncertainty comes from working with big events on state space, some of them coming in form of states of variables, as opposed to individual states. See Probability Space, Random Variable, also E.T. Jaynes (1990) "Probability Theory as Logic" may be helpful.

Comment author: PhilGoetz 09 April 2009 04:28:50AM *  0 points [-]

According to Wikipedia, that is what is meant by epistemic uncertainty. It says that one type of uncertainty is

"1. Uncertainty due to variability of input and / or model parameters when the characterization of the variability is available (e.g., with probability density functions, pdf),"

and that all other types of uncertainty are epistemic uncertainty.

And here's a quote from "Separating natural and epistemic uncertainty in flood frequency analysis", Bruno Merz and Annegret H. Thieken, J. of Hydrology 2004, which also agrees with me:

"Natural uncertainty stems from variability of the underlying stochastic process. Epistemic uncertainty results from incomplete knowledge about the process under study."

Comment author: Vladimir_Nesov 09 April 2009 10:47:11AM *  1 point [-]

This "natural uncertainty" is a property of distributions, while epistemic uncertainty to which you refer here corresponds to what I meant. When you have incomplete knowledge about the process under study, you are working with one of the multiple possible processes, you are operating inside a wide event that includes all these possibilities. I suspect you are still confusing the prior on global state space with marginal probability distributions on variables. Follow the links I gave before.