RomeoStevens comments on Intelligence explosion in organizations, or why I'm not worried about the singularity - Less Wrong

13 Post author: sbenthall 27 December 2012 04:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (187)

You are viewing a single comment's thread.

Comment author: RomeoStevens 28 December 2012 01:24:28AM 14 points [-]

Never mind the singularity, organizations aren't friendly and I'm worried about them.

Comment author: Gavin 30 December 2012 06:21:08AM *  3 points [-]

Yes, Unfriendly organizations are a major threat to humanity. The battle is ongoing. The death toll stands in the tens of millions, much higher if you want to count generously. So yes, unfriendly organizations are a real threat. But they're one that we're all aware of. Luckily, a host of Friendly people and organizations are dedicated to fighting them, studying them, and mitigating their damage. And many people end up counteracting them, simply by living generally good lives.

Taking the long view of history, I believe that, over the last few hundred years, we have been winning this battle. There's news of tragedy every day, but by many measures 2012 was the world's best year ever.

The UFAI threat, if the SIAI argument is correct, is a sudden and irreversible threat that is currently ignored even by those attempting to build AGI. That's why a small group of dedicated individuals has chosen it as their best chance to influence the future. They're applying pressure where they believe it can have the greatest effect. No one has claimed that it was the only threat, just a very important one.