Vladimir_Nesov comments on Decision Theories: A Less Wrong Primer - Less Wrong

69 Post author: orthonormal 13 March 2012 11:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (172)

You are viewing a single comment's thread.

Comment author: Vladimir_Nesov 12 March 2012 11:32:14AM *  2 points [-]

with some weird caveats: for example, if X started out as CDT, its modification will only care about other agents' decisions made after X self-modified

I'm guessing what matters is not so much time as the causal dependence of those decisions made by other agents on the physical event of the decision of X to self-modify. So the improved X still won't care about its influence on future decisions made by other agents for reasons other than X having self-modified. For example, take the (future) decisions of other agents that are space-like separated from X's self-modification.

Even more strangely, I'm guessing agents that took a snapshot of X just before self-modification, able to predict its future actions, will be treated by X differently depending on whether they respond to observations of the physical events caused by the behavior of improved X, or to the (identical) inferences made based on the earlier snapshot.

Comment author: orthonormal 12 March 2012 03:48:20PM 0 points [-]

Correct, of course. I sacrificed a little accuracy for the sake of being easier for a novice to read; is there a sentence that would optimize both?

Comment author: Vladimir_Nesov 12 March 2012 03:59:00PM *  0 points [-]

Do you understand this effect well enough to rule its statement "obviously correct"? I'm not that sure it's true, it's something built out of an intuitive model of "what CDT cares about", not technical understanding, so I would be interested in an explanation that is easier for me to read... (See another example in the updated version of grandparent.)

Comment author: orthonormal 12 March 2012 04:13:51PM 0 points [-]

Right, we don't really understand it yet, but on an informal level it appears valid. I think it's worth mentioning at a basic level, though it deserves a fuller discussion. Good example.