michael_vassar comments on The Truly Iterated Prisoner's Dilemma - Less Wrong

18 Post author: Eliezer_Yudkowsky 04 September 2008 06:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (85)

Sort By: Old

You are viewing a single comment's thread.

Comment author: michael_vassar 05 September 2008 04:02:56PM 0 points [-]

But Eliezer, you can't assume that Clippy uses the same decision making process that you do unless you know that you both unfold from the same program with different utility functions or something. If you have the code that unfolds into Clippy and Clippy has the code that unfolds into you it may be that you can look at Clippy's code and see that Clippy defects if his model of you defects regardless of what he does and cooperates if his model of you cooperates if your model of him cooperates, but you don't have his code. You can't say much about all possible minds or about all possible paperclip maximizing minds.