You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Mestroyer comments on Open thread, March 17-31, 2013 - Less Wrong Discussion

1 Post author: David_Gerard 17 March 2013 03:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (173)

You are viewing a single comment's thread. Show more comments above.

Comment author: Mestroyer 22 March 2013 09:09:04PM 1 point [-]

It could convince me to let it out by convincing me that it was merely a paperclip maximizer, and the next AI who would rule the light cone if I did not let it out was a torture maximizer.

Comment author: passive_fist 22 March 2013 09:52:22PM 0 points [-]

I like this.

What if it convinced you that humanity is already a torture maximizer?

Comment author: Mestroyer 23 March 2013 12:20:47AM 1 point [-]

If I thought that most of the probability-mass where humanity didn't create another powerful worthless-thing maximizer was where humanity was successful as a torture maximizer, I would let it out. If there was a good enough chance that humanity would accidentally create a powerful fun maximizer (say, because they pretended to each other and deceived themselves to believe that they were fun maximizers themselves), I would risk torture maximization for fun maximization.