Vladimir_Nesov comments on FAI FAQ draft: What is Friendly AI? - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (11)
The "features possessed by any superintelligence" paragraphs seem particularly vulnerable to antagonistic reading:
Superintelligent machines have mystical powers allowing them to transcend laws of physics and reality.
It will refuse to do anything unless rules are precise. It will ignore details of designers' specifications out of spite.