Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Nick_Tarleton comments on Devil's Offers - Less Wrong

21 Post author: Eliezer_Yudkowsky 25 December 2008 05:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (46)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Nick_Tarleton 26 December 2008 05:16:34AM 2 points [-]

an inadvertent change of utility function is extremely dangerous, because changing your utility function is of infinite negative utility by the standards of your current utility, and vice-versa.

Not true at all. A change from N_paperclips to N_paperclips + 10^-100*N_staples, for instance, probably has no effect. A change to N_paperclips + .5*N_staples might result in fewer paperclips, but finitely many.