Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Allan_Crossman comments on The True Prisoner's Dilemma - Less Wrong

56 Post author: Eliezer_Yudkowsky 03 September 2008 09:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (112)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Allan_Crossman 03 September 2008 10:01:41PM 4 points [-]

I agree: Defect!

Clearly the paperclip maximizer should just let us have all of substance S; but a paperclip maximizer doesn't do what it should, it just maximizes paperclips.

I sometimes feel that nitpicking is the only contribution I'm competent to make around here, so... here you endorsed Steven's formulation of what "should" means; a formulation which doesn't allow you to apply the word to paperclip maximizers.