Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Grant comments on Devil's Offers - Less Wrong

21 Post author: Eliezer_Yudkowsky 25 December 2008 05:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (46)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Grant 25 December 2008 04:37:38PM 14 points [-]

In addition to what James said, I'm reminded of the mechanism to change screen resolution in Windows XP: It automatically resets to its original resolution in X seconds, in case you can't see the screen. This is so people can't break their computers in one moment of weakness.

A similar thing could be done with self-modification. Self-destruction would still be possible, of course, just as it is now (I could go jump off of a bridge). But just as suicide is something that is built up to in humans, failsafes could be put in place so self-modification was equally deliberate.

Comment author: Baughn 26 May 2015 04:09:47PM 0 points [-]

In addition to what James said, I'm reminded of the mechanism to change screen resolution in Windows XP: It automatically resets to its original resolution in X seconds, in case you can't see the screen. This is so people can't break their computers in one moment of weakness.

But you are absolutely allowed to break your computer in "one moment of weakness"; it isn't even hard. The reason for that dialog is because the computer honestly, genuinely can't predict if the new screen mode will work.