# shokwave comments on Problematic Problems for TDT - Less Wrong

34 29 May 2012 03:41PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Sort By: Best

You are viewing a single comment's thread.

Comment author: 23 May 2012 07:52:54AM *  3 points [-]

Problems 1 and 2 both look - to me - like fancy versions of the Discrimination problem. edit: I am much less sure of this. That is, Omega changes the world based on whether the agent implements TDT. This bit I am still sure of, but it might be the case that TDT can overcome this anyway.

Discrimination problem: Money Omega puts in room if you're TDT = \$1,000. Money Omega puts in room if you're not = \$1,001,000.

Problem 1: Money Omega puts in room if you're TDT = \$1,000 or \$1,001,000. Edit: made a mistake. The error in this problem may be subtler than I first claimed. Money Omega puts in room if you're not = \$1,001,000.

Problem 2: \$1,000,000 either way. This problem is different but also uninteresting. Due to Omega caring about TDT again, it is just the smallest interesting number paradox for TDT agents only. Other decision theories get a free ride because you're just asking them to reason about an algorithm (easy to show it produces a uniform distribution) and then a maths question (which box has the smallest number on it?).

You claim the rewards are

independent of the method that the agent uses to choose

but they're not. They depend on whether the agent uses TDT to choose or not.

Comment author: 23 May 2012 08:51:37AM 2 points [-]

I've edited the problem statement to clarify Box A slightly. Basically, Omega will put \$1001000 in the room (\$1000 for box A and \$1 million for Box B) regardless of the algorithm run by the actual deciding agent. The contents of the boxes depend only on what the simulated agent decides.

Comment author: 23 May 2012 08:11:35AM 2 points [-]

Agree. You use process X to determine the setup and agents instantiating X are going to be constrained. Any decision theory would be at a disadvantage when singled out like this.

Comment author: 23 May 2012 08:29:27AM *  0 points [-]

Problem 1: Money Omega puts in room if you're TDT = \$1,000 or \$1,000,000.

Sorry, shouldn't it be "\$1,000 or \$1,001,000"?

Comment author: 23 May 2012 10:06:39AM 0 points [-]

Right, but \$1,001,000 only in the case where you restrict yourself to picking \$1,000,000. I oversimplified and it might not actually be accurate.