rwallace comments on Ingredients of Timeless Decision Theory - Less Wrong

43 Post author: Eliezer_Yudkowsky 19 August 2009 01:10AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (226)

You are viewing a single comment's thread. Show more comments above.

Comment author: rwallace 20 August 2009 10:44:54PM 0 points [-]

(I don't remember where I first read that variant, but Martin Gardner sounds likely.) Yes, I agree with your analysis of it -- but that doesn't contradict the assertion that you can solve these problems by extending your utility function across parallel versions of you who received slightly different sensory data. I will conjecture that this turns out to be the only elegant solution.

Comment author: Eliezer_Yudkowsky 20 August 2009 11:22:40PM 0 points [-]

Sorry, that doesn't make any sense. It's a probability distribution that's the issue, not a utility function. UDT tosses out the probability distribution entirely. TDT still uses it and therefore fails on Counterfactual Mugging.

Comment author: rwallace 20 August 2009 11:38:54PM -1 points [-]

It's precisely the assertion that all such problems have to be solved at the probability distribution level that I'm disputing. I'll go so far as to make a testable prediction: it will be eventually acknowledged that the notion of a purely selfish agent is a good approximation that nonetheless cannot handle such extreme cases. If you can come up with a theory that handles them all without touching the utility function, I will be interested in seeing it!

Comment author: Nick_Tarleton 21 August 2009 06:43:05AM 0 points [-]

None of the decision theories in question assume a purely selfish agent.

Comment author: rwallace 21 August 2009 07:46:32AM 0 points [-]

No, but most of the example problems do.