Eugine_Nier comments on Mini advent calendar of Xrisks: nanotechnology - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (25)
My relatively uninformed impression was that the particularly unique nanotech risk was poor programming leading to grey goo.
Is there a reason that economic disruption or increased weapon capacity are greater x-risks - which I thought were focused on under-appreciated but extreme downside risks. The examples from the article have greater expected harm because they are higher probability, but x-risks are civilization or humanity destroyers, aren't they? Does economic disruption really have that large a downside?
The problem is that the grey goo has to out-compete the biosphere, which is hard if you're designing nanites from scratch. If you're basing them of existing lifeforms, that's synthetic biology.
Yes, it's very similar to the problem of designing a macroscopic robot that can out-compete natural predators of the same size. Early attempts will probably fail completely, and then we'll have a few generations of devices that are only superior in some narrow specialty or in controlled environments.
But just as with robots, the design space of nanotech devices is vastly larger than that of biological life. We can easily imagine an industrial ecology of Von Neumann machines that spreads itself across a planet exterminating all large animal life, using technologies that such organisms can't begin to compete with (mass production, nuclear power, steel armor, guns). Similarly, there's a point of maturity at which nanotech systems built with technologies microorganisms can't emulate (centralized computation, digital communication, high-density macroscopic energy sources) become capable of displacing any population of natural life.
So I'd agree that it isn't going to happen by accident in the early stages of nanotech development. But at some point it becomes feasible for governments to design such a weapon, and after that the effort required goes down steadily over time.
One difference is that the reproduction rate, and hence rate of evolution, of micro-organisms is much faster.