Wei_Dai comments on Ingredients of Timeless Decision Theory - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (226)
I'm trying to understand the difference between this formulation and mine. Interestingly, Eliezer seems to have specified a "causal" timeless decision theory, whereas mine could be described as an "evidential" TDT. In my formulation, you'd compute the expected utility of a strategy (i.e., mapping of inputs to outputs) T by taking "S is logically equivalent to T" as a (provisional) axiom, then recomputing logical uncertainties and expected utility.
The "evidential" approach seems simpler. What advantage does the "causal" approach have? Sorry if this is obvious, but my knowledge of Pearl is very limited.
Parfit's Hitchhiker; in the future, after having observed that you've already been picked up and made it to safety, you'll still compute the counterfactual "If the output of my computation were to refuse to pay, then I would not have been picked up."
Since TDT screens off all info that goes into your decision-setup, using your updateless version of TDT might obliterate the difference between evidential and causal approaches entirely - no counterfactuals, no updates, just ruling out of self-copies that have received incompatible sense data. (Not sure yet if this works.)
CTDT vs. ETDT. Hmm, that's a tough one. First, CTDT allows "screening off" of causes, which makes a big difference.
I liked EY's formulation above: "TDT doesn't cooperate or defect depending directly on your decision, but cooperates or defects depending on how your decision depends on its decision." It's hard to collect evidence, I think, but reasoning about a causal graph gives you the ability to find out how latent decisions affect other outcomes.
So in this case, expected utility based reasoning leaves you in a posiiton where you make some decisions because they seem correlated with good outcomes, while the causal reasoning lets you sometimes see either that the actions and consequences are disconnected or that the causation runs in the opposite direction to what you desire.
ETA: EY's street crossing example is an example of causation running in the opposite direction.
= Drescher's street crossing example, don't know if Drescher got it from somewhere else.