You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

JoshuaFox comments on Snowdenizing UFAI - Less Wrong Discussion

5 Post author: JoshuaFox 05 December 2013 02:42PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (71)

You are viewing a single comment's thread. Show more comments above.

Comment author: JoshuaFox 05 December 2013 04:26:50PM *  3 points [-]

I agree.

But the threat would hover over every AGI project. You'd have a team of people, many of whom took the pledge (or may have done so without everyone knowing), and everyone would know that the project has to rely on everyone continuing to violate their earlier pledge.

Also, since the team would be smart people aware of AGI progress outside their organization, they would know that they are violating a deep deontological norm based on clear consequentalist principles. True, people find justifications for what they do, on the assumption that possibly-successful AGI researchers are smart and also have some rationalism in them, this idea would also cast a shadow.

Not only researchers, but their managers would no this.

And if you think that a leak is valuable -- all it takes is one person to do it.