Unknowns comments on What if AI doesn't quite go FOOM? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (186)
Why? Predicting my actions doesn't make them actions I don't want to take. Predicting I'll eat a sandwich if I want one doesn't hurt me; and if others can predict that I'll cooperate on the prisoner's dilemma iff my opponent will cooperate iff I'll cooperate, so much the better for all concerned.
Can you give an example of a case where being predictable would hurt someone who goes about choosing actions well in the first place? Note that, as with the PD thing above, actions are dependent on context; if the prediction changes the context, then that will already be factored into an accurate prediction.
Alicorn, your note about the PD implies that it is universally the case that there is some one action that will benefit you even if others predict it. There is no reason to think that this is the case; and if there is even one instance where doing what others predict you will do is harmful, then being universally predictable is a weakness.