timtyler comments on Holden Karnofsky's Singularity Institute Objection 1 - Less Wrong

8 Post author: ciphergoth 11 May 2012 07:16AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (60)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 28 May 2012 05:48:05PM 0 points [-]

If someone were to announce credibly "We're creating a GAI. Nobody else but us is allowed to even think about what it is going to do. Just trust us, it's Friendly." then the appropriate response is to shout "Watch out! It's a dangerous crackpot! Stop him before he takes over the world and potentially destroys us all!" And make no mistake, if this kind of attempt at suppression were taken by anyone remotely near developing an FAI theory that is what it would entail. Fortunately at this point it is still at the "Mostly Harmless" stage.

I don't see how anyone could credibly announce that. The announcement radiates crackpottery.