timtyler comments on Decision theory: Why Pearl helps reduce “could” and “would”, but still leaves us with at least three alternatives - Less Wrong

30 Post author: AnnaSalamon 06 September 2009 06:10AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (70)

You are viewing a single comment's thread.

Comment author: timtyler 06 September 2009 09:40:06AM 1 point [-]

Agents do not need to calculate what would have happened, if something impossible had happened.

They need to calculate the consequences of their possible actions.

These are all possible, by definition, from the point of view of the agent - who is genuinely uncertain about the action she is going to take. Thus, from her point of view at the time, these scenarios are not "counterfactual". They do not contradict any facts known to her at the time. Rather they all lie within her cone of uncertainty.

Comment author: Nick_Tarleton 06 September 2009 04:46:40PM 6 points [-]

These are all possible, by definition, from the point of view of the agent

... but nevertheless, all but one are, in fact, logically impossible.

Comment author: Alicorn 06 September 2009 04:59:23PM 10 points [-]

That's the difference between epistemic and metaphysical possibility. Something can be epistemically possible without being metaphysically possible if one doesn't know if it's metaphysically possible or not.

Comment author: Nick_Tarleton 06 September 2009 06:25:36PM *  1 point [-]

Thanks, that's exactly what I was trying to say.

Comment author: timtyler 06 September 2009 05:42:25PM -2 points [-]

What do you mean?

Are you perhaps thinking of a type of classical determinism - that pre-dates the many-worlds perspective...?

Comment author: Nick_Tarleton 06 September 2009 06:25:18PM *  2 points [-]

I'm thinking of determinism. I don't know what you mean by "classical" or in what way you think many-worlds is non-"classically"-deterministic (or has any bearing on decision theory).

Comment author: timtyler 06 September 2009 07:22:10PM 0 points [-]

If all your possible actions are realised in a future multiverse of possibilities, it is not really true that all but one of those actions is "logically impossible" at the point when the decision to act is taken.

Many-worlds doesn't have a lot to do with decision theory - but it does bear on your statement about paths not taken being "impossible".

Comment author: Eliezer_Yudkowsky 06 September 2009 08:26:51PM *  2 points [-]

Actually, the way that TDT defines a decision, only one decision is ever logically possible, even under many-worlds. Versions of you that did different things must have effectively computed a different decision-problem.

Comment author: timtyler 06 September 2009 08:49:52PM -1 points [-]

Worlds can split before a decision - but they can split 1 second before, 1 millisecond before - or while the decision to be made is still being evaluated.

Comment author: Eliezer_Yudkowsky 06 September 2009 09:01:50PM *  1 point [-]

So? Versions of you that choose different strategies must have ended up performing different computations due to splits at whatever time, hence, under TDT, one decision-process still only makes one decision.

Comment author: PhilGoetz 02 April 2011 08:10:25PM *  1 point [-]

Counterfactuals don't need to be about impossible things - and agents do calculate what would have happened, if something different had happened. And it is very hard to know whether it would have been possible for something different to happen.

The problem of counterfactuals is not actually a problem. Goodman's book is riddled with nonsensical claims.

What can Pearl's formalism accomplish, that earlier logics could not? As far as I can tell, "Bayes nets" just means that you're going to make as many conditional-independence assumptions as you can, use an acyclic graph, and ignore time (or use a synchronous clock). But nothing changes about the logic.

Comment author: timtyler 02 April 2011 08:52:25PM *  0 points [-]

What can Pearl's formalism accomplish, that earlier logics could not? As far as I can tell, "Bayes nets" just means that you're going to make as many conditional-independence assumptions as you can. But nothing changes about the logic.

I am not sure. I haven't got much from Pearl so far. I did once try to go through The Art and Science of Cause and Effect - but it was pretty yawn-inducing.

Comment author: timtyler 02 April 2011 08:36:07PM 0 points [-]

I was replying to this bit in the post:

The problem of counterfactuals is the problem what we do and should mean when we we discuss what “would” have happened, “if” something impossible had happened

...and this bit:

Recall that we seem to need counterfactuals in order to build agents that do useful decision theory -- we need to build agents that can think about the consequences of each of their “possible actions”, and can choose the action with best expected-consequences. So we need to know how to compute those counterfactuals.

It is true that agents do sometimes calculate what would have happened if something in the past had happened a different way - e.g. to help analyse the worth of their decision retrospectively. That is probably not too common, though.