pjeby comments on Open Thread: July 2010, Part 2 - Less Wrong

6 Post author: Alicorn 09 July 2010 06:54AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (770)

You are viewing a single comment's thread. Show more comments above.

Comment author: pjeby 06 August 2010 02:54:46PM 4 points [-]

Is a FAI friendly towards superintelligent, highly conscious uFAI? No, it's not. It will kill it.

Are you sure? Random alternative possibilities:

  • Hack it and make it friendly
  • Assimilate it
  • Externally constrain its actions
  • Toss it into another universe where humanity doesn't exist

Unless you're one yourself, it's rather difficult to predict what other options a superintelligence might come up with, that you never even considered.