paper-machine comments on Open Thread, July 16-31, 2012 - Less Wrong

3 Post author: OpenThreadGuy 16 July 2012 12:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (141)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 17 July 2012 11:58:46PM *  1 point [-]

It seems to me that an agent that self-modified to answer "Yes" to this sort of question in the future but said "No" this time

This strategy is not reflectively consistent. From the new TDT PDF:

A decision algorithm is reflectively inconsistent whenever an agent using that algorithm wishes she possessed a different decision algorithm.

If an agent implemented your strategy, they would change decision strategies every time they come across a predictor that flipped heads.