You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

hairyfigment comments on Is causal decision theory plus self-modification enough? - Less Wrong Discussion

-4 Post author: Mitchell_Porter 10 March 2012 08:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (52)

You are viewing a single comment's thread.

Comment author: hairyfigment 10 March 2012 08:57:09AM 0 points [-]

Supposedly we want a new, reflective decision theory because you can't have "a CDT agent who can self-modify."

Comment author: RobertLumley 10 March 2012 02:48:28PM 0 points [-]

I ask this more as a question, not as a statement, because I'm not terribly familiar with TDT or AI (I'm just an engineering student who's maybe 1/3 of the way through the sequences) but is there any conflict between TDT and self modification? Suppose we modify Newcomb's problem somewhat, and say that Omega is predicting whether or not you were a one boxer a year ago. Suppose an AI was, in fact, a two boxer a year ago and self modified to be a one boxer now. Since Omega could simply read the code, it would know this. But by my understanding, a TDT AI would still one box in this situation, which would lose.