Andreas_Giger comments on Open Thread, September 30 - October 6, 2013 - Less Wrong

4 Post author: Coscott 30 September 2013 05:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (295)

You are viewing a single comment's thread.

Comment author: Andreas_Giger 01 October 2013 11:07:48AM 0 points [-]

I saw this post from EY a while ago and felt kind of repulsed by it:

I no longer feel much of a need to engage with the hypothesis that rational agents mutually defect in the oneshot or iterated PD. Perhaps you meant to analyze causal-decision-theory agents?

Never mind the factual shortcomings, I'm mostly interested in the rejection of CDT as rational. I've been away from LW for a while and wasn't keeping up on the currently popular beliefs on this site, and I'm considering learning a bit more about TDT (or UDT or whatever the current iteration is called). I have a feeling this might be a huge waste of time though, so before I dive into the subject I would like to confirm that TDT has objectively been proven to be clearly superior to CDT, by which I (intuitively) mean:

  • There exist no problems shown to be possible in real life for which CDT yields superior results.
  • There exists at least one problem shown to be possible in real life for which TDT yields superior results.

"Shown to be possible in real life" excludes Omega, many-worlds, or anything of similar dubiousness. So has this been proven? Also, is there any kind of reaction from the scientific community in regards to TDT/UDT?

Comment author: IlyaShpitser 01 October 2013 01:15:14PM *  10 points [-]

The question "which decision theory is superior?" has this flavor of "can my dad beat up your dad?"

CDT is what you use when you want to make decisions from observational data or RCTs (in medicine, and so on).

TDT is what you use when "for some reason" your decisions are linked to what counterfactual versions/copies of yourself decided. Standard CDT doesn't deal with this problem, because it lacks the language/notation to talk about these issues. I argue this is similar to how EDT doesn't handle confounding properly because it lacks the language to describe what confounding even means. (Although I know a few people who prefer a decision algorithm that is in all respects isomophic to CDT, but which they prefer to call EDT for I guess reasons having to do with the formal epistemology they adopted. To me, this is a powerful argument for not adopting a formal epistemology too quickly :) )


I think it's more fruitful to think about the zoo of decision theories out there in terms of what they handle and what they break on, rather than in terms of anointing some of them with the label "rational" and others with the label "irrational." These labels carry no information. There is probably no total ordering from "best to worst" (for example people claim EDT correctly one boxes on Newcomb, whereas CDT does not. This does not prevent EDT from being generally terrible on the kinds of problems CDT handles with ease due to a worked out theory of causal inference).

Comment author: Andreas_Giger 01 October 2013 07:43:17PM 1 point [-]

I don't like the notion of using different decision theories depending on the situation, because the very idea of a decision theory is that it is consistent and comprehensive. Now if TDT were formulated as a plugin that seamlessly integrated into CDT in such a way that the resulting decision theory could be applied to any and all problems and would always yield optimal results, then that would be reason for me to learn about TDT. However, from what I gathered this doesn't seem to be the case?

Comment author: Slackson 01 October 2013 09:33:59PM 3 points [-]

TDT performs exactly as well as CDT on the class of problems CDT can deal with, because for those problems it essentially is CDT. So in practice you just use normal CDT algorithms except for when counterfactual copies of yourself are involved. Which is what TDT does.

Comment author: Vaniver 03 October 2013 07:24:18PM 0 points [-]

I argue that there's an mapping in the opposite direction: if you add extra nodes to any problem that looks like a problem where TDT and CDT disagree, and adjust which node is the decision node, then you can make CDT and TDT agree (and CDT give the "TDT solution"). This is obvious in the case of Newcomb's Problem, for example.

Comment author: IlyaShpitser 04 October 2013 11:27:35AM *  1 point [-]

I guess it's true that CDT needed lots of ideas to work. TDT has one idea: "link counterfactual decisions together." So it is not an unreasonable view that TDT is an addendum to CDT, and not vice versa, since CDT is intellectually richer.

Comment author: Slackson 01 October 2013 12:58:17PM *  2 points [-]

This is essentially what the TDT paper argues. It's been a while since I've read it, but at the time I remember being sufficiently convinced that it was strictly superior to both CDT and EDT in the class of problems that those theories work with, including problems that reflect real life.

Comment author: Andreas_Giger 02 October 2013 01:42:02AM *  -1 points [-]

I think people have slightly misunderstood what I was referring to with this:

  • There exist no problems shown to be possible in real life for which CDT yields superior results.
  • There exists at least one problem shown to be possible in real life for which TDT yields superior results.

My question was whether there is a conclusive, formal proof for this, not whether this is widely accepted on this site (I already realized TDT is popular). If someone thinks such a proof is given somewhere in an article (this one?) then please direct me to the point in the article where I can find that proof. I'm very suspicious about this though, since the wiki makes blatantly false claims, e.g. that TDT performs better in one-shot PD than CDT, while in fact it can only perform better if access to source coude is given. So the wiki article feels more like promotion than anything.

Also, I would be very interested to hear about what kind of reaction from the scientific community TDT has received. Like, very very interested.

Comment author: Oscar_Cunningham 01 October 2013 12:37:48PM -2 points [-]

"Shown to be possible in real life" excludes Omega, many-worlds, or anything of similar dubiousness.

Then no. In "normal" situations CDT does as well as anything else.

Comment author: Slackson 01 October 2013 12:59:46PM 6 points [-]

Didn't the paper show TDT performing better than CDT in Parfit's Hitchhiker?

Comment author: Oscar_Cunningham 01 October 2013 01:12:09PM 6 points [-]

That might count as being of similar dubiousness, although I like this quote by Eliezer arguing otherwise:

Decision theories should not break down when confronted by Paul Ekman; he is a real person.