thomblake comments on Counterfactual Mugging v. Subjective Probability - Less Wrong

1 Post author: MBlume 20 July 2009 04:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (32)

You are viewing a single comment's thread. Show more comments above.

Comment author: thomblake 21 July 2009 06:08:32PM 1 point [-]

Because the point of a self-modifying AI is that it will be able to self-modify in situations we don't anticipate. Being able to predict its self-modification in principle is useful precisely because we can't hard-code every special case.