You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

buybuydandavis comments on Stupid Questions Open Thread Round 3 - Less Wrong Discussion

8 Post author: OpenThreadGuy 07 July 2012 05:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (208)

You are viewing a single comment's thread. Show more comments above.

Comment author: buybuydandavis 08 July 2012 11:52:07AM 2 points [-]

People here seem confident that there exists a decision theory immune to blackmail.

Really? I hope not. Sound like a very silly idea to me. Does that just mean unresponsive to coercion? Pretending like you never heard it? Always refusing to give in to a threat? I suppose one could program that into an AI, and when someone says to the AI, "your money or your life", we'll get a dead AI. Why not just program your AI to self destruct when threatened? Sometimes, knuckling under is the right call.

Comment author: TheOtherDave 08 July 2012 04:11:00PM 1 point [-]

...and sometimes choosing to die is.

Comment author: buybuydandavis 08 July 2012 11:40:33PM 2 points [-]

Sometimes. As long as it's only sometimes, maybe you're better off not always driving off the cliff.

I see some people recommending broadcasting your precommmitment to not knuckle under to blackmail. Not so good when you run into a blackmailer with a precommitment to always follow through. And not so good when the other guy isn't certain about your precommitment. Or if he is just a spiteful prick. Never underestimate the power of spite.