eli_sennesh comments on International cooperation vs. AI arms race - Less Wrong

15 Post author: Brian_Tomasik 05 December 2013 01:09AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (143)
Tags: ai arms_race international_relations nonproliferation cooperation

Comments (143)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 14 December 2013 10:26:55PM 0 points [-]

Interesting. So there are backup safety strategies. That's quite comforting to know, actually.

I think the scenario James elaborated was meant to be a fictional portrayal of a bad outcome that we should seek to avoid. That it was pasted without context may have given the impression that he actually supported such a strategy.

Oh thank God. I'd like to apologize for my behavior, but to be honest this community is oftentimes over my Poe's Law Line where I can no longer actually tell if someone is acting out a fictional parody of a certain idea or actually believes in that idea.

Next time I guess I'll just assign much more probability to the "this person is portraying a fictional hypothetical" notion.

If winning the race is better than letting someone else win, then you're willing to tolerate some increased risk of killing everyone.

Sorry, could you explain? I'm not seeing it. That is, I'm not seeing how increasing the probability that your victory equates with your own suicide is better than letting someone else just kill you. You're dead either way.

Comment author: Brian_Tomasik 15 December 2013 03:32:41AM 1 point [-]

No worries. :-)

That is, I'm not seeing how increasing the probability that your victory equates with your own suicide is better than letting someone else just kill you. You're dead either way.

Say that value(you win) = +4, value(others win) = +2, value(all die) = 0. If you skimp on safety measures for yourself, you can increase your probability of winning relative to others, and this is worth some increased chance of killing everyone. Let me know if you want further clarification. :) The final endpoint of this process will be a Nash equilibrium, as discussed in "Racing to the Precipice," but what I described could be one step toward reaching that equilibrium.

Powered by Reddit Powered by Reddit