You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

NancyLebovitz comments on Do Earths with slower economic growth have a better chance at FAI? - Less Wrong Discussion

30 Post author: Eliezer_Yudkowsky 12 June 2013 07:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (174)

You are viewing a single comment's thread. Show more comments above.

Comment author: NancyLebovitz 13 June 2013 09:08:25AM 2 points [-]

UFAI might be developed by a large company as well as by a country.

Comment author: Thomas 13 June 2013 09:11:26AM 0 points [-]

Or by a garage firm.

Comment author: [deleted] 13 June 2013 05:02:06PM 1 point [-]

Is it plausible that UFAI (or any kind of strong AI) will be created by just one person? It seems like important mathematical discoveries have been made single-handedly, like calculus.

Comment author: JoshuaZ 13 June 2013 06:20:25PM *  3 points [-]

Neither Newton nor Liebniz invented calculus single-handedly as is often described. There was a lot of precursor work. Newton for example credited the idea of the derivative to Fermat's prior work on drawing tangent lines (which itself was a generalization of ancient Greek ideas about tangents for conic sections). Others also discussed similar notions before Newton and Liebniz such as the mean speed theorem. After both of them, a lot of work still needed to be done to make calculus useful. The sections of calculus which Newton and Liebniz did is only about half of what is covered in a normal into calc class today.

A better example might be Shannon's development of information theory which really did have almost no precursors and did leap from his brow fully formed like Athena.

Comment author: Randaly 13 June 2013 05:15:23PM 2 points [-]

UFAI is not likely to be a purely mathematical discovery. The most plausible early UFAI designs will require vast computational resources and huge amounts of code.

In addition, UFAI has a minimum level of intelligence required before it becomes a threat; one might well say that UFAI is analogous not to calculus itself, but rather to solving a particular problem in calculus that uses tools not invented for hundreds of years after Newton and Leibniz.

Comment author: Thomas 13 June 2013 05:37:36PM 1 point [-]

AI is a math problem, yes. And almost all math problems have been solved by a single person. And several math theories were also build this way. Single-headedly.

Abraham Lincoln invented another proof for Pythagorean Theorem. Excellent for a POTUS, more than most mathematicians ever accomplish. Not good enough for anything like AI.

Could be, that the AI problem is not harder than Fermat Last Theorem. Could be that it is much harder. Harder than Riemann's conjecture, maybe.

It is also possible that it is just hard enough for one dedicated (brilliant) human and will be solved suddenly.

Comment author: NancyLebovitz 13 June 2013 05:27:23PM 0 points [-]

I don't think it will be just one person, but I don't have a feeling for how large a team it would take. Opinions?