MaoShan comments on Counterfactual resiliency test for non-causal models - Less Wrong

21 Post author: Stuart_Armstrong 30 August 2012 05:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (78)

You are viewing a single comment's thread. Show more comments above.

Comment author: MaoShan 20 September 2012 03:06:33AM 0 points [-]

That's exactly my point, most of the counter-arguments you gave for the other two predictive models were along those lines, but only when it came to countering Moore's law did you put those weapons away and play gently.

Comment author: Stuart_Armstrong 20 September 2012 09:26:22AM *  2 points [-]

Simple version: if your model includes phenomena X in its timeline, yet does not make any claims about X having causal influence, then I can play with X to attempt to break your model.

Hence I used the weapons that were implicit in the model. For Kurzweil's model, it includes the history of evolution on earth, a history littered with disasters, meteor impacts and the like. Since the model is claimed to be correct despite these disasters, I decided that adding a few more shouldn't break the model if the model actually worked.

I was gentler on Robin's model, because it focused more on narrowly on human evolution. Still, it covers a period in history where there were pandemic, genetic bottlenecks, dramatic expansions of new technology, and so on. If the model was correct across these phenomena, then I could play with them without blowing up the model.

What would be equivalent for Moore's much narrower law? Well, there are no "unless economic growth splutters" caveats. So the most credible way to break Moore's law is to add a few economic disasters and imagine their consequences. But actual real economic disasters seem to have not affected Moore's law at all. What else? Political change? This might work - there's some evidence that communist states didn't have a Moore's law for their own computer industry. So a global communist takeover could break Moore's law - or at least caveat it to "in a market economy, computer speeds will..."

Comment author: MaoShan 21 September 2012 02:12:57AM 0 points [-]

Thanks, I see your point now. If that's the case, though, it really just boils down to "(models that we have extremely accurate data and current physical and recorded evidence for) tend to produce more accurate predictions than (models that are less so)".

Comment author: Stuart_Armstrong 21 September 2012 06:06:25AM 0 points [-]

Not exactly. Robin's and Kurzweil's model have more data! (as they include Moore's law as a subcomponent).

Comment author: MaoShan 22 September 2012 03:27:28AM 0 points [-]

Don't you agree that Moore's law is the only trustworthy part of their models, though?

Comment author: Stuart_Armstrong 22 September 2012 03:34:54PM 0 points [-]

Simply pointing out that it's not just the quantity of the data that matters, but other factors too.

Comment author: Vaniver 22 September 2012 03:41:49AM 0 points [-]

I think Robin's info about GDP growth throughout history is decent, too.

Comment author: V_V 16 October 2013 04:21:18PM *  0 points [-]

GDP estimates of premodern societies are highly speculative, and anyway the GDP of a premodern society was probably not a good measure of the magnitude of its economic activity.