You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Lumifer comments on Should we go all in on existential risk? - Considering Effective Altruism - Less Wrong Discussion

4 Post author: Capla 10 November 2014 11:23PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (43)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 13 November 2014 04:48:52PM 0 points [-]

You seem to want to describe a situation where I have uncertainty about probabilities, and hence uncertainty about expected values.

Correct.

there are no generally accepted theories (certainly not "plenty") for decision making with imprecise credence.

Really? Keep in mind that in reality people make decisions on the basis of "imprecise probabilities" all the time. In fact, outside of controlled experiments, it's quite unusual to know the precise probability because real-life processes are, generally speaking, not that stable.

It is very misleading to invoke diversification, risk premia, etc. as analogous or applicable to this discussion.

On the contrary, I believe it's very illuminating to apply these concepts to the topic under discussion.

I did mention finance which is a useful example because it's a field where people deal with imprecise probabilities all the time and the outcomes of their decisions are both very clear and very motivating. You don't imagine that when someone, say, characterizes a financial asset as having the expected return of 5% with 20% volatility, these probabilities are precise, do you?

Comment author: AlexSchell 16 November 2014 01:07:10AM 0 points [-]

You don't imagine that when someone, say, characterizes a financial asset as having the expected return of 5% with 20% volatility, these probabilities are precise, do you?

Those are not even probabilities at all.

Comment author: Lumifer 16 November 2014 07:57:32PM 0 points [-]

Such an expression usually implies a normal probability distribution with the given mean and standard deviation. How do you understand probabilities as applied to continuous variables?

Comment author: AlexSchell 16 November 2014 01:05:04AM *  0 points [-]

There are two very different sorts of scenarios with something like "imprecise probabilities".

The first sort of case involves uncertainty about a probability-like parameter of a physical system such as a biased coin. In a sense, you're uncertain about "the probability that the coin will come up heads" because you have uncertainty about the bias parameter. But when you consider your subjective credence about the event "the next toss will come up heads", and integrate the conditional probabilities over the range of parameter values, what you end up with is a constant. No uncertainty.

In the second sort of case, your very subjective credences are uncertain. On the usual definition of subjective probabilities in terms of betting odds this is nonsense, but maybe it makes some sense for boundedly introspective humans. Approximately none of the decision theory corpus applies to this case, because it all assumes that credences and expected values are constants known to the agent. Some decision rules for imprecise credence have been proposed, but my understanding is that they're all problematic (this paper surveys some of the problems). So decision theory with imprecise credence is currently unsolved.

Examples of the first sort are what gives talk about "uncertain probabilities" its air of reasonableness, but only the second case might justify deviations from expected utility maximization. I shall have to write a post about the distinction.

Comment author: Lumifer 16 November 2014 08:01:33PM *  0 points [-]

But when you consider your subjective credence about the event "the next toss will come up heads", and integrate the conditional probabilities over the range of parameter values, what you end up with is a constant. No uncertainty.

Really? You can estimate your subjective credence without any uncertainty at all? You integration of the conditional probabilities over the range of parameter values involves only numbers you are fully certain about?

I don't believe you.

Approximately none of the decision theory corpus applies to this case

So this decision theory corpus is crippled and not very useful. Why should we care much about it?

So decision theory with imprecise credence is currently unsolved.

Yes, of course, but life in general is "unsolved" and you need to make decisions on a daily basis, not waiting for a proper decision theory to mature.

I think you overestimate the degree to which abstractions are useful when applied to reality.

Comment author: AlexSchell 16 November 2014 10:42:44PM -1 points [-]

The fact that the assumptions of an incredibly useful theory of rational decisionmaking turn out not to be perfectly satisfied does not imply that we get to ignore the theory. If we want to do seemingly crazy things like diversifying charitable donations, we need an actual positive reason, such as the prescriptions of a better model of decisionmaking that can handle the complications. Just going with our intuition that we should "diversify" to "reduce risk", when we know that those intuitions are influenced by well-documented cognitive biases, is crazy.

This has been incredibly unproductive I can't believe I'm still talking to you kthxbai

Comment author: Lumifer 17 November 2014 12:29:03AM -1 points [-]

I can't believe I'm still talking to you kthxbai

Ah.

Thank you for clarity.

Comment author: Capla 17 November 2014 11:58:37PM 1 point [-]

I'm not sure what I'm should take away from that exchange.

Comment author: AlexSchell 21 November 2014 05:49:15PM 0 points [-]

Ignore the last sentence and take the rest for what it's worth :) I did the equivalent of somewhat tactlessly throwing up my hands after concluding that the exchange stopped being productive (for me at least, if not for spectators) a while ago.

Comment author: Lumifer 18 November 2014 02:23:36AM 0 points [-]

Anything in particular you are wondering about? :-)

Comment author: Capla 18 November 2014 03:03:40AM 0 points [-]

Just my original question. I'm not sure if diversification to mitigate charitable risk is a matter of preference or numeric objectivity.

Comment author: Lumifer 18 November 2014 05:25:35AM -1 points [-]

Try making up your own mind..? :-)

Comment author: Capla 18 November 2014 09:31:40PM *  0 points [-]

Someone told me not to.

(this is a joke)