buybuydandavis comments on Stupid Questions Open Thread Round 3 - Less Wrong

8 Post author: OpenThreadGuy 07 July 2012 05:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (208)

You are viewing a single comment's thread. Show more comments above.

Comment author: buybuydandavis 08 July 2012 11:52:07AM 2 points [-]

People here seem confident that there exists a decision theory immune to blackmail.

Really? I hope not. Sound like a very silly idea to me. Does that just mean unresponsive to coercion? Pretending like you never heard it? Always refusing to give in to a threat? I suppose one could program that into an AI, and when someone says to the AI, "your money or your life", we'll get a dead AI. Why not just program your AI to self destruct when threatened? Sometimes, knuckling under is the right call.

Comment author: TheOtherDave 08 July 2012 04:11:00PM 1 point [-]

...and sometimes choosing to die is.

Comment author: buybuydandavis 08 July 2012 11:40:33PM 2 points [-]

Sometimes. As long as it's only sometimes, maybe you're better off not always driving off the cliff.

I see some people recommending broadcasting your precommmitment to not knuckle under to blackmail. Not so good when you run into a blackmailer with a precommitment to always follow through. And not so good when the other guy isn't certain about your precommitment. Or if he is just a spiteful prick. Never underestimate the power of spite.