If you don't believe that a foom is the most likely outcome(a common and not unreasonable position) then it's probably better to have lots of weakly-superhuman AI than a single weakly-superhuman AI.
Even in that case, whichever actor has the most processors would have the largest "AI farm", with commensurate power projection.
From their website, it looks like they'll be doing a lot of deep learning research and making the results freely available, which doesn't sound like it would accelerate Friendly AI relative to AI as a whole. I hope they've thought this through.
Edit: It continues to look like their strategy might be counterproductive. [Edited again in response to this.]
That interview is indeed worrying. I'm surprised by some of the answers.
Great news! I've been waiting for this kind of thing.
More likely, he also "always thought that way," and the extreme story was written to provide additional drama.
Thank you for replicating the experiment!
Where are you getting that much money?
Somewhat upper middle class job; low cost of living, inexpensive hobbies, making donations a priority.
I donated $5000 today and continue my $1000 monthly donations.
Oh, for pity's sake. You want to repeatedly ad hominem attack XiXiDu for being a "biased source." What of Yudkowsky? He's a biased source - but perhaps we should engage his arguments, possibly by collecting them in one place.
"Lacking context and positive examples"? This doesn't engage the issue at all. If you want to automatically say this to all of XiXiDu's comments, you're not helping.
I feel, and XiXiDu seems to agree, that his posts require a disclaimer or official counterarguments. I feel it's appropriate to point out that someone has made collecting and spreading every negative aspect of a community they can find into a major part of their life.
So MIRI and LW are no longer a focus for you going forward?
View more: Next
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)
How big a deal is this? What, if anything, does it signal about when we get smarter than human AI?
Eliezer thinks it's a big deal.