JGWeissman comments on Rationality Quotes: November 2010 - Less Wrong

5 [deleted] 02 November 2010 08:41PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (354)

You are viewing a single comment's thread. Show more comments above.

Comment author: JGWeissman 09 November 2010 08:19:56PM 1 point [-]

They do better on some problems, and worse on others.

Do you have an example of a problem on which CDT or EDT does better than TDT?

Comment author: Perplexed 09 November 2010 08:25:35PM 2 points [-]

I have yet to see a description of TDT which allows me to calculate what TDT does on an arbitrary problem. But I do know that I have seen long lists from Eliezer of problems that TDT does not solve that he thinks it ought to be improved so as to solve.

Comment author: orthonormal 09 November 2010 09:47:31PM 0 points [-]

The world isn't sufficiently formalized for us to meet that standard for any decision theory (though we come closer with CDT and TDT than with EDT, in my opinion). However, cousin_it has a few recent posts on formalized situations where an agent of a more TDT (actually, UDT) type does strictly better than a CDT one in the same situation. I don't know of any formalization (or any fuzzy real-world situation) where the opposite is true.

Comment author: Perplexed 09 November 2010 10:05:53PM *  0 points [-]

I apparently misled you by using that word "arbitrary". I'm not asking for solutions to soft problems that are difficult to formalize. Simply solutions to the standard kinds of games already formalized in game theory. For example, the game of Chicken. Can anyone point me to a description that tells me what play TDT would make in this game? Or what mixed strategy it would use? Both assuming and not assuming the reading of each other's code.

ETA: Slightly more interesting than the payoff matrix shown in the wikipedia article is the case when the payoff for a win is 2 units, with a loss still costing only -1. This means that in the iterated version, the negotiated solution would be to alternate wins. But we are interested in the one-shot case.

Can TDT find a correlated equilibrium? If not, which Nash equilibrium does it pick? Or does it always chicken out? Where can I learn this information?

Comment author: JGWeissman 09 November 2010 08:31:12PM 0 points [-]

But I do know that I have seen long lists from Eliezer of problems that TDT does not solve that he thinks it ought to be improved so as to solve.

Since CDT and EDT don't solve those problems either, all this justifies saying is that TDT does better on some problems, and the same on others, not "worse on others".

Comment author: timtyler 11 November 2010 10:57:42PM 1 point [-]

For every possible decision theory, there is a "nemesis" environment - where it does extremely badly. That is no-free-lunch fall out.

Comment author: JGWeissman 11 November 2010 11:07:53PM 1 point [-]

A "nemesis" environment that feeds misleading evidence to a decision theory's underlying epistimology does not indicate the sort of problem illustrated by an environment in which a decision theory does something stupid with true information.

Comment author: timtyler 12 November 2010 12:03:23AM 0 points [-]

What you asked for was a case where a decision theory did worse than its rivals.

However, that seems pretty trivial if it behaves differently from them - you just consider an appropriate pathological environment set up to punish that decision theory.

Comment author: JGWeissman 12 November 2010 12:24:10AM 0 points [-]

What you asked for was a case where a decision theory did worse than its rivals.

Yes, in the context of Perplexed dismissing examples of TDT doing better than CDT because CDT was being stupid with true information.