Larks comments on How can we compare decision theories? - Less Wrong

6 Post author: bentarm 18 August 2010 01:29PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (41)

You are viewing a single comment's thread. Show more comments above.

Comment author: Larks 18 August 2010 05:02:10PM 3 points [-]

Omega is relevant because AGIs might show each other their source code, at which point they gain the predictive powers, vis-a-vis each other, of Omega.

On the other hand, an AGI running CDT would self-modify to UDT/TDT if running UDT/TDT lead to better outcomes, so maybe we can leave the decision theoretic work to our AGI.

The issue there is that a 'proof' of friendliness might rely on a lot of decision theory.