PART THREE:
Penrose (1994). *Shadows of the Mind. Oxford University Press.
Phoenix (2005). Molecular manufacturing: What, why, and how. Center for Responsible Nanotechnology.
Popov, Kyotani, Nemanich, & Koga (2002). Superhard phase composed of single-wall carbon nanotubes. Physical Review B, 65: 033408.
Rae, Digney, McEwan, & Bates (2003). Oral creatine monohydrate supplementation improves brain performance: A double-blind, placebo-controlled, cross-over trial. Proceedings of the Royal Society of London Series B, Biological Sciences, 270: 2147–2150.
Repantis, Schlattmann, et al. (2010). Modafinil and methylphenidate for neuroenhancement in healthy individuals: A systematic review. Pharmacological Research, 62: 187-206.
Roache (2008). Ethics, speculation, and values. Nanoethics, 2: 317-327.
Roesch-Ely, Scheffel, et al. (2005). Differential dopaminergic modulation of executive control in healthy subjects. Psychopharmacology (Berlin), 178: 420–430.
Rusted, Trawley, Heath, Kettle, & Walker (2005). Nicotine improves memory for delayed intentions. Psychopharmacology (Berl), 182: 355–365.
Sandberg (2010). An overview of models of technological singularity. Presented at the “Roadmaps to AGI and the future of AGI” workshop following the AGI 2010 conference in Lugano, Switzerland.
Sandberg & Bostrom (2008). Whole Brain Emulation: A Roadmap. Technical Report 2008-3. Future of Humanity Institute, Oxford University.
Sandberg & Bostrom (2011). Machine intelligence survey, Technical Report 2011-1, Future of Humanity Institute, Oxford.
Sawyer (2007). Robot ethics. Science, 318: 1037.
Schmidhuber (2007). Gödel Machines: Fully Self-Referential Optimal Universal Self-Improvers. In Goertzel & Pennachin (eds.), Artificial General Intelligence (pp. 199–226). Springer.
Schwartz (1987). Limits of Artificial Intelligence. In Shapiro & Eckroth (eds.), Encyclopedia of Artificial Intelligence, Vol. 1 (pp. 488-503). John Wiley and Sons, Inc.
Searle (1980). Minds, Brains, and Programs. Behavioral and Brain Sciences, 3: 417–424.
Schroeder (2004). Three Faces of Desire. Oxford University Press.
Stanovich (2010). Rationality and the Reflective Mind. Oxford University Press.
Sternberg (1985). Implicit Theories of Intelligence, Creativity, and Wisdom. Journal of Personality and Social Psychology 49: 607–627.
Sternberg, Conway, Ketron, & Bernstein (1981). People’s Conceptions of Intelligence. Journal of Personality and Social Psychology, 41: 37–55.
Sternberg & Grigorenko (2006). Cultural Intelligence and Successful Intelligence. Group & Organization Management, 31: 27–39.
Tang, Shimizu, Dube, Rampon, Kerchner, Zhuo, Liu, & Tsien (1999). Genetic enhancement of learning and memory in mice. Nature, 401: 63–69.
Turing (1950). Computing machinery and intelligence. Mind, 59: 433-460.
Turing (1951/2004). Intelligent machinery, a heretical theory. In Copeland (ed.), The Essential Turing (2004). Oxford University Press. Originally presented in 1951 as a lecture for the ‘51 society in Manchester.
Turner, Clark, Dowson, Robbins, & Sahakian (2004). Modafinil improves cognition and response inhibition in adult attention-deficit/hyperactivity disorder. Biological Psychiatry, 55: 1031-1040.
Vinge (1981). True Names. In Dell Binary Star #5.
Vinge (1993). The coming technological singularity: How to survive in the post-human era. Whole Earth Review, winter 1993. New Whole Earth.
Wallach & Allen (2009). Moral Machines. Oxford University Press.
Wallach, Allen, & Smit (2008). Machine morality: Bottom-up and top-down approaches for modeling human moral faculties. AI and Society, 22: 565–582.
Watanabe, Kato, & Kato (2002). Effects of creatine on mental fatigue and cerebral hemoglobin oxygenation. Neuroscience Research, 42(4), 279–285.
Williams & Herrup (1988). The control of neuron number. Annual Review of Neuroscience, 11: 423–53.
Yudkowsky (1996). Staring into the Singularity.
Yudkowsky (2000). Creating a Transhuman AI.
Yudkowsky (2001). Creating Friendly AI.
Yudkowsky (2002). The AI-Box Experiment.
Yudkowsky (2004). Coherent extrapolated volition.
Yudkowsky (2007). Three Major Singularity Schools.
Yudkowsky (2008). Artificial intelligence as a negative and positive factor in global risk. In Bostrom & Cirkovic (eds)., Global Catastrophic Risks. Oxford University Press.
Zanello, Zhao, Hu, & Haddon (2006). Nano Letters, 6: 562-567.
Zentall (2011). Animal intelligence. In Sternberg & Kaufman (eds.), The Cambridge Handbook of Intelligence (pp. 309-327). Cambridge University Press.
I invite your feedback on this snippet from the forthcoming Friendly AI FAQ. This one is an answer to the question "What is the Singularity?"
_____
There are many types of mathematical and physical singularities, but in this FAQ we use the term 'Singularity' to refer to the technological singularity.
There are also many things someone might have in mind when they refer to a 'technological Singularity' (Sandberg 2010). Below, we’ll explain just three of them (Yudkowsky 2007):
Intelligence explosion
Every year, computers surpass human abilities in new ways. A program written in 1956 was able to prove mathematical theorems, and found a more elegant proof for one of them than Russell and Whitehead had given in Principia Mathematica (MacKenzie 1995). By the late 1990s, 'expert systems' had surpassed human skill for a wide range of tasks (Nilsson 2009). In 1997, IBM's Deep Blue computer beat the world chess champion (Campbell et al. 2002), and in 2011 IBM's Watson computer beat the best human players at a much more complicated game: Jeopardy! (Markoff 2011). Recently, a robot named Adam was programmed with our scientific knowledge about yeast, then posed its own hypotheses, tested them, and assessed the results (King et al. 2009; King 2011).
Computers remain far short of human intelligence, but the resources that aid AI design are accumulating (including hardware, large datasets, neuroscience knowledge, and AI theory). We may one day design a machine that surpasses human skill at designing artificial intelligences. After that, this machine could improve its own intelligence faster and better than humans can, which would make it even more skilled at improving its own intelligence. This could continue in a positive feedback loop such that the machine quickly becomes vastly more intelligent than the smartest human being on Earth: an 'intelligence explosion' resulting in a machine superintelligence (Good 1965).
Event horizon
Vernor Vinge (1993) wrote that the arrival of machine superintelligence represents an 'event horizon' beyond which humans cannot model the future, because events beyond the Singularity will be stranger than science fiction: too weird for human minds to predict. So far, all social and technological progress has resulted from human brains, but humans cannot predict what future radically different and more powerful intelligences will create. He made an analogy to the event horizon of a black hole, beyond which the predictive power of physics at the gravitational singularity breaks down.
Accelerating Change
A third concept of technological singularity refers to accelerating change in technological development.
Ray Kurzweil (2005) has done the most to promote this idea. He suggests that although we expect linear technological change, information technological progress is exponential, and so the future will be more different than most of us expect. Technological progress enables even faster technological progress. Kurzweil suggests that technological progress may become so fast that humans cannot keep up unless they amplify their own intelligence by integrating themselves with machines.