= 27d567bc2d48d9f40e9ccc20ea370b15)
Morendil comments on The Importance of Self-Doubt - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (726)
AGI researchers who are not concerned with Friendliness are trying to destroy human civilization. They may not believe that they are doing so, but this does not change the fact of the matter. If FAI is important, only people who are working on FAI can be expected to produce positive outcomes with any significant probability.
"Trying to" normally implies intent.
I'll grant that someone working on AGI (or even narrower AI) who has become aware of the Friendliness problem, but doesn't believe it is an actual threat, could be viewed as irresponsible - unless they have reasoned grounds to doubt that their creation would be dangerous.
Even so, "trying to destroy the world" strikes me as hyperbole. People don't typically say that the Project Manhattan scientists were "trying to destroy the world" even though some of them thought there was an outside chance it would do just that.
On the other hand, the Teller report on atmosphere ignition should be kept in mind by anyone tempted to think "nah, those AI scientists wouldn't go ahead with their plans if they thought there was even the slimmest chance of killing everyone".