The ancient Greek world, with its steam engines, philosophers and mathematicians, seems an ideal location for a counterfactual. Any philosophical, social or initial technological development that we could label as essential to industrialisation, could at least plausibly have arisen in a Greek city or colony - possibly over a longer period of time.
But... steam engines, philosophers, and mathematicians aren't the critical elements for the Industrial Revolution! If they were, it would have happened in Greece.
Here's a short story of why the Industrial Revolution happened in Britain/Holland/Northern Germany:
Six centuries of (mostly) peace, atomic households, and downward social mobility (i.e. the upper middle class having more children than the lower class, and their secondary and tertiary children becoming the lower middle class) led to a significant change in British demographics. It's little surprise that the industrial revolution would occur in a nation of shopkeepers, and it took about 30 generations of evolution to make them shopkeepery enough to have the industrial revolution.
Abundant coal made energy cheap, even after wood and peat reserves were depleted. Steam engines be
It seems to me that the differences you measure between different theories here are entirely subsumed under N, the number of trials we have. For the Martin Luther theory, N=1 - Martin nailed up the theses twice. N=4 for Robin Hanson. I'm not sure how to measure N for Ray Kurzweil, but N for Moore's Law is close to 25. Your argument for Moore's Law seems mainly reliant on that: "robust for moves to very different technologies, and has spanned cultural transformations and changes in the purpose and uses of computers" - if any of the others had 25 examples, they would seem robust to all those things!
It seems rather easy to mess with the inputs T. Weather conditions or continental drifts could confine pre-agricultural humans to hunting essentially indefinitely
This is sort of amazing, but after a couple million years of hunting and gathering humans developed agriculture independently within a few thousand years in multiple locations (the count is at least 7, possibly more).
This really doesn't have a good explanation, it's too ridiculous to be a coincidence, and there's nothing remotely like a plausible common cause.
There's a very plausible common cause. Humans likely developed the traits that allowed them to easily invent agriculture during the last glacial period. The glacial period ended 10 000 years ago, so that's when the climate became amenable to agriculture.
How do you judge the plausibility of a counterfactual?
You say "we can imagine" some of these scenarios more easily than others. But our imaginations aren't magic. There are plenty of things I can imagine that on closer examination are virtually impossible. And plenty of real things that I couldn't imagine until I knew about them.
If we had a good causal model, we could apply it. But we're usually interested in non-causal models precisely when causal models are intractable.
If the counterfactuals' plausibilities boil down to "I said so", then so does the entire argument.
I think this approach show some promise, but if I am understanding it correctly it seems like it has a significant weakness. From what I understand non-causal models do assume that there is something causing the trend, they just don't address what it is. It seems like when a model fails this resiliency test it could be because its a bad model, but it is also possible that the hidden cause makes the counterfactual less likely than it seems. More generally, the models make retroactive predictions about the real world and treat the entire real world as a bl...
The model I have of human progress is this. Intelligence is not the limiting factor. Things are invented quite soon after they become possible and worthwhile.
So, let's take the steam engine. Although the principle of the steam turbine is known to the Greeks, actual steam engines are only commercially viable from the time of Newcomen's atmspheric engine. Why not earlier?
Well, there is an existing technology to displace, first of all, which is a couple of unfortunate animals walking in a circle driving an axle. This is far more fuel efficient than the steam ...
It's a good article, but I think you are being more lenient in your alternative scenarios to Moore's law, and only really trying to mess up the other two. An asteroid wiping out half the earth's population in 1985 or a worldwide conversion to Amish principles would definitely screw up Moore's law, but...those type of things only happen to naughty predictions. On top of that, no matter how wacky the divergence from reality, you have been able to insert a plausible revision of the prediction based on that scenario, so for every blow you deal, you are also providing the bandage along with it; how imaginative you choose to be is what is determining the resilience.
If there were dramatically more domesticable species available, that would imply differences in evolutionary history as well, and the abundant resources available to civilization would accelerate subsequent technological development as well. Many of your proposed counterfactuals seem to have the same flaw, implying exponential growth with slightly different coefficients rather than a completely broken model.
Nitpicking : the sentence « four centuries after Luther's thesis in Luther's 95 theses thesis in 1957 » seems broken to me. Both the date and the repetition.
This pattern-matches in my mind to the Stability theory, only you try to use large changes instead of tiny ones, which might be too much of a jump.
It might be worth considering small changes in the initial conditions (is that what you call T?). In the Reformation example, would having 94 theses make a difference? What if Luther's proclamation was not translated to German? Etc.
Suppose you establish that a model is stable to small perturbations (how? seems to need math), you can then try to see where the tipping points are. If there is no such stability, the model is probably useless.
Whatever past trends were, the rate of progress must slow as we approach physical limits. For example, there must be some minimum size for a reliable resistor. So even if we accept the inevitability of certain past trends, extrapolation is risky.
Once we've used most of the oil (or phosphate, for which there's no substitute), past trends driven by culture, technology, or economics won't continue. In agriculture, best-farmer yields haven't increased much since 1980, although averages go up as they buy their neighbors' land. (My recent book on Darwinia...
I'm not sure that these conterfactual arguments are appropriate.
However, it seems to me that Moore is obviously in a different category than Hanson and Kurzweil:
Moore's law was formulated as a description of an empirically observable trend. As far as I know, Moore didn't use it to make far future predictions (the Wikipedia page quotes a prediction at 10 years). Moreover, Moore's laws refers to well-defined variables (transistor density at minimum cost per transistor, in the original formulation) for which accurate and complete estimates are available.
Hanso...
Non-causal models
Non-causal models are quite common in many fields, and can be quite accurate. Here predictions are made, based on (a particular selection of) past trends, and it is assumed that these trends will continue in future. There is no causal explanation offered for the trends under consideration: it's just assumed they will go on as before. Non-causal models are thus particularly useful when the underlying causality is uncertain or contentious. To illustrate the idea, here are three non-causal models in computer development:
Before anything else, I should thank Moore, Hanson and Kurzweil for having the courage to publish their models and put them out there where they can be critiqued, mocked or praised. This is a brave step, and puts them a cut above most of us.
That said, though I find the first argument quite convincing, I find have to say I find the other two dubious. Now, I'm not going to claim they're misusing the outside view: if you accuse them of shoving together unrelated processes into a single model, they can equally well accuse you of ignoring the commonalities they have highlighted between these processes. Can we do better than that? There has to be a better guide to the truth that just our own private impressions.
Counterfactual resilience
One thing I'd like to do is test the resilience of the model - how robust are they to change. If model M makes prediction P from trends T and the real outcome will be O, we can test resiliency in two ways. First, we can change the world to change T (and hence P), without changing O, or we can change the world to change O, without changing T (and hence P). If we can do either or both, this is a strong indication that the model doesn't work.
This all sounds highly dubious - how can we "change the world" in that way? I'm talking about considering counterfactuals: alternate worlds whose history embodies the best of our knowledge as to how the real world works. To pick an extremely trivial example, imagine someone who maintains that the West's global domination was inevitable four centuries after Luther's 95 theses thesis in 1517, no matter what else happened outside Europe. Then we can imagine counterfactually diverting huge asteroids to land in the Channel, or import hyper-virulent forms of bird flu from Asiatic Russia. According to everything we know about asteroid impacts, epidemiology and economics, this would not have lead to a dominant West for many centuries afterwards.
That was an example of keeping T and P, and changing the outcome O. It is legitimate: we have preserved everything that went into the initial model, and made the prediction wrong. We could take the reverse approach: changing T and P while preserving the outcome O. To do so, we could imagine moving Luther (or some Luther-like character) to 1217, without changing the rest of European history much. To move Luther back in time, we could perfectly imagine that the Catholic church had started selling and abusing indulgences much earlier than they did - corrupt clerics were hardly an impossible idea in the middle ages. It requires a bit religious and social changes to have the 95 these make sense in the thirteenth century, but not all that much. Then we could imagine that Luther-like character being ignored or burnt, and the rest of Western history happening as usual, without western world dominance happening four centuries after that non-event (which is what M would have predicted). Notice that in both these cases, considering counterfactuals allows us to bring our knowledge or theories about other facts of the world to bear on assessing the model - we are no longer limited to simply debating the assumptions of the model itself.
"Objection!" shouts my original strawman, at both my resiliency tests. "Of course I didn't specify 'unless a meteor impacts'; that was implicit and obvious! When you say 'let's meet tomorrow', you don't generally add 'unless there's a nuclear war'! Also, I object to your moving Luther three centuries before and saying my model would predict the same thing in 1217. I was referring to Luther nailing up his theses, in the context of an educated literate population, with printing presses and a political system that was willing to stand up to the Catholic church. Also, I don't believe you when you say there would need to not be 'all that much' religious and social changes for early Luther to exist. You'd have to change so much, that there's no way you could put history back on the 'normal' track afterwards."
Notice that the conversation has moved on from 'outside view' arguments, to making explicit implicit assumptions, extending the model, and arguing about our understanding of causality. Thus if these counterfactual resiliency tests don't break a model, they're likely to improve it, our understanding, and the debate.
The resilience of these models
So let's apply this to Robin Hanson's and Ray Kurzweil's models. I'll start with Robin's, as it's much more detailed. The key inputs of Robin's model are the time differences between the different revolutions (brains, hunting, agriculture, industry), and the growth rates after these revolutions. The prediction is that there is another revolution coming about three centuries after the industrial revolution, and that after this the economy will double every 1-2 weeks. He then makes the point that the only plausible way for this to happen is through the creation of brain emulations or AIs - copyable human capital. I'll also assume the implicit "no disaster" assumption: meteor strikes or world governments bent on banning AI research. How does this fare in counterfactuals?
It seems rather easy to mess with the inputs T. Weather conditions or continental drifts could confine pre-agricultural humans to hunting essentially indefinitely, followed by a slow evolution to agriculture when the climate improved or more lands became available. Conversely, we could imagine incredibly nutritious crops that were easy to cultivate, and hundreds of domesticable species, rather than the 30-40 we actually had. Combine this with a mass die-off of game and some strong evolutionary pressure, and we could end up with agriculture starting much more rapidly.
This sounds unfair - are these not huge transformations to the human world and the natural world that I'm positing here? Indeed I am, but Robin's model is that these differential growth rates have predictive ability, not that these differential growth rates combined with a detailed historical analysis of many contingent factors have predictive ability. If the model were to claim that the vagaries of plate tectonics and the number of easily domesticated species in early human development have relevance to how long after the industrial revolution would brain emulations be developed, then something has gone wrong with it.
Continuing on this vein, we can certainly move the industrial revolution back in time. The ancient Greek world, with its steam engines, philosophers and mathematicians, seems an ideal location for a counterfactual. Any philosophical, social or initial technological development that we could label as essential to industrialisation, could at least plausibly have arisen in a Greek city or colony - possibly over a longer period of time.
We can also tweak the speed of economic growth. The yield on hunting can be changed through the availability or absence of convenient prey animals. During the agricultural era, we could posit high-yield crops and an enlightened despot who put in place some understandable-to-ancient-people elements of the green revolution - or conversely, poor yield crops suffering from frequent blight. Easy or difficult access to coal would affect growth during the industrial era, or we could jump ahead by having the internal combustion engine, not the steam engine, as the initial prime driver of industrialisation. The computer era could be brought forwards by having Babbage complete his machines for the British government, or pushed backwards by removing Turing from the equation and assuming the Second World War didn't happen.
You may disagree with some of these ideas, but it seems to me that there are just too many contingent factors that can mess up the input to the model, leading some putative parallel-universe Robin Hanson to give completely different times to brain emulations. This suggests the model is not very resilient.
Or we can look at the reverse: making whole brain emulations much easier, or much harder, than they are now, without touching the inputs to the model at all (and hence its predictions). For instance, if humans were descendant from a hibernating species, it's perfectly conceivable that we could have brains that would be easy to fixate and slice up for building emulations. Other changes to our brain design could also make this easier. It might be that our brains had a different architecture, one where it was much simpler to isolate a small "consciousness module" or "decision making module". Under these assumptions, we could conceivably have had adequate emulations back in the 60s or 70s! Again, these assumptions are false - life didn't happen like that, it may be impossible for life to happen like that - but knowing that these assumptions are false requires knowledge that is neither explicitly nor implicitly in the model. And of course we have converses: brain architectures too gnarly and delicate to fix and slice. Early or late neuroscience breakthroughs (and greater or lesser technological or medical returns on these breakthroughs). Greater or lesser popular interest in brain architecture.
For these reasons, it seems to me that Robin Hanson's model fails the counterfactual resiliency test. Ray Kuzweil's model suffers similarly - since Kurweil's model includes the whole of evolutionary history (including disasters), we can play around with climate, asteroid collisions and tectonics to make evolution happen at very different rates (one easy change is to kill off all humans in the Toba catastrophe). Shifting around the date of the technological breakthroughs and that of first computer still messes up with the model, and backdating important insights allows us to imagine much earlier AIs.
And then there's Moore's law, starting with Moore's 1965 paper... The difference is immediately obvious, as we start trying to apply the same tricks to Moore's law. Where even to start? Maybe certain transistors designs are not available? Maybe silicon is hard to get ahold of rather than being ubiquitous? Maybe Intel went bust at an early stage? Maybe no-one discovered photolithography? Maybe some specific use of computers wasn't thought of, so demand was reduced? Maybe some special new chip design was imagined ahead of time?
None of these seem to clearly lead to situations where Moore's law would fail. We don't really know what causes Moore's law, but it has been robust for moves to very different technologies, and has spanned cultural transformations and changes in the purpose and uses of computers. It seems to lie at the interaction between markets demand, technological development, and implementation. Some trivial change could conceivably throw it off its rails - but we just don't know what, which means we can't bring our knowledge about other facts in the world to bear.
In conclusion: more work needed
It was the comparative ease with which we could change the components of the other two models that revealed their lack of resilience; it is the difficulty of doing so with Moore's law that shows it is resilient.
I've never seen this approach used before; more resilience tests only involve changing numerical parameters from inside the model. Certainly the approach needs to be improved: it feels very informal and subjective for the moment. Nevertheless, I feel that it has afforded me some genuine insights, and I'm hoping to improve and formalise it in future - with any feedback I get here, of course.