Qiaochu_Yuan comments on The Need for Human Friendliness - Less Wrong

6 Post author: Elithrion 07 March 2013 04:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (28)

You are viewing a single comment's thread.

Comment author: Qiaochu_Yuan 08 March 2013 08:47:33AM 9 points [-]

Extreme transparency increases the probability of government intervention at some late stage of the game (attempting to create a friendly AI constitutes attempting to create an extremely powerful weapon).

See what I did there? I changed the genre from sci-fi to political thriller.

Comment author: [deleted] 09 March 2013 05:01:52PM 1 point [-]

So if the awareness that MIRI is working on an AGI in secret (or rather, without sharing details) happens to get to the government, and they consider it a powerful weapon as you say...then what? You know what they do to grandiose visionaries working on powerful weapons in their backyard who explicitly don't want to share, and whose goals pretty clearly compromise their position, right?