Larks comments on How can we compare decision theories? - Less Wrong

6 Post author: bentarm 18 August 2010 01:29PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (41)
Tags: decision_theory

Comments (41)

You are viewing a single comment's thread. Show more comments above.

Comment author: PhilGoetz 18 August 2010 03:38:47PM 0 points [-]

I have no doubt that TDT is an improvement on CDT, but in order for this to even make sense, we'd have to have some way of thinking about what sort of problem we want our decision theory to solve. Presumably the answer is "the sort of problems which you're actually likely to face in the real world".

If that's so, why do we spend so much time talking about Newcomb problems? Should we ban Omega from our decision theories?

Comment author: Larks 18 August 2010 05:02:10PM 3 points [-]

Omega is relevant because AGIs might show each other their source code, at which point they gain the predictive powers, vis-a-vis each other, of Omega.

On the other hand, an AGI running CDT would self-modify to UDT/TDT if running UDT/TDT lead to better outcomes, so maybe we can leave the decision theoretic work to our AGI.

The issue there is that a 'proof' of friendliness might rely on a lot of decision theory.

Powered by Reddit Powered by Reddit