[Link]: Anthropic shadow, or the dark dusk of disaster

10 Post author: Stuart_Armstrong 04 July 2013 07:52PM

From a paper by Milan M. Ćirković, Anders Sandberg, and Nick Bostrom:

We describe a signicant practical consequence of taking anthropic biases into account in deriving predictions for rare stochastic catastrophic events. The risks associated with catastrophes such as asteroidal/cometary impacts, supervolcanic episodes, and explosions of supernovae/gamma-ray bursts are based on their observed frequencies. As a result, the frequencies of catastrophes that destroy or are otherwise incompatible with the existence of observers are systematically underestimated. We describe the consequences of this anthropic bias for estimation of catastrophic risks, and suggest some directions for future work.

There cannot have been a large disaster on Earth in the last millennia, or we wouldn't be around to see it. There can't have been a very large disaster on Earth in the last ten thousand years, or we wouldn't be around to see it. There can't have been a huge disaster on Earth in the last million years, or we wouldn't be around to see it. There can't have been a planet-destroying disaster on Earth... ever.

Thus the fact that we exist precludes us seeing certain types of disasters in the historical record; as we get closer and closer to the present day, the magnitude of the disasters we can see goes down. These missing disasters form the "anthropic shadow", somewhat visible in the top right of this diagram:

Hence even though it looks like the risk is going down (the magnitude is diminishing as we approach the present), we can't rely on this being true: it could be a purely anthropic effect.

 

Comments (25)

Comment author: Nornagest 04 July 2013 08:16:45PM *  11 points [-]

I'm not an astronomer, but my understanding is that when it comes to impact events, the probability of a planet-killer probably is going down over time: after an impact event, the impactor isn't around to pose a threat anymore, and there are only so many large objects with Earth-crossing orbits. At this point we're far enough out on a long enough tail that the probability density isn't changing much over time, but that's not true over the timescales being graphed; if we're dating lunar rocks accurately, extinction-scale impact events last peaked around 3.9 Gya, and were rare after 3 Gya. I'd be surprised if that trend hasn't to some extent continued.

More generally, if you want a good estimate of the near-term probability of impact events, you probably want to survey one or several of the other bodies in the solar system. They have an impact record relatively untainted by anthropic bias, and also have the advantage of being a lot easier to read, as most of them lack the plate tectonics that wipe out a lot of older geology on Earth. That said, though, there are extinction events that wouldn't be affected by the later evolution of the solar system: nearby supernovae, for example, or gamma-ray bursts.

Comment author: JoshuaZ 04 July 2013 08:19:59PM 7 points [-]

More generally, if you want a good estimate of the near-term probability of impact events, you probably want to survey one or several of the other bodies in the solar system. They have an impact record relatively untainted by anthropic bias, and also have the advantage of being a lot easier to read, lacking the plate tectonics that tend to wipe out a lot of older geology on Earth.

And this has been done. We have good records of impact levels on the Moon, Mars and Jupiter (although Jupiter is a little weird). It doesn't look like there's heavy anthropic bias there.

Comment author: satt 08 July 2013 07:25:01PM 1 point [-]

We have good records of impact levels on the Moon, Mars and Jupiter (although Jupiter is a little weird).

Ćirković, Sandberg & Bostrom refer to these briefly in the paper, but seem to think they're not adequate or as relevant:

For instance, the asteroidal and cometary impact history of the solar system is, in theory, easier to obtain for the Moon, where the erosion is orders of magnitude weaker than on Earth. In practice, this is still not feasible for obtaining the fair sampling of the impactors because: (1) precise dating of a large set of lunar craters is beyond our present capacities and (2) most of the large lunar craters are known to originate in a highly special epoch of the so-called Late Heavy Bombardment, ca. 4.0-3.8 billion years B.P., thus strongly skewing any attempt to plot the empirical distribution function of impacts for "normal" times. In practice, in the current debates about the rates of cometary and asteroidal impacts, it is the terrestrial cratering rates that are used as an argument for or against the existence of a dark impactor population, thus offering a good case on which the anthropic model bias can, at least potentially, be tested. [Footnote & endnote references omitted.]

Comment author: Manfred 05 July 2013 06:08:50AM 0 points [-]

It doesn't look like there's heavy anthropic bias there.

Citation?

Comment author: JoshuaZ 05 July 2013 01:55:15PM 3 points [-]

I don't have a citation for this, more a general familiarity with the literature on the subject, and that no one has ever said "hey it looks like we should have seen a lot more impacts on Earth than we've apparently gotten" or anything similar.

Comment author: Manfred 05 July 2013 02:07:44PM *  1 point [-]

and that no one has ever said "hey it looks like we should have seen a lot more impacts on Earth than we've apparently gotten"

Wouldn't this be a (weak, since humans have lots of reasons) piece of evidence that people see the same pattern of collision sizes on earth as on e.g. the moon?

Comment author: JoshuaZ 05 July 2013 02:12:58PM *  3 points [-]

Yes, and that's the point: that suggests that there's little anthropic bias at work here. A heavy anthropic bias would be if we didn't see the same collision patterns.

Comment author: Nornagest 05 July 2013 06:14:34AM *  2 points [-]

This paper seems to have some useful data. I'd be happier with a table of crater sizes and ages that I could plug into Octave and fit a regression to, but so far I haven't been able to come up with any decent-sized datasets.

ETA: The Lunar Impact Crater Database could probably do it, if you feel like doing some messy conversion.

Comment author: CellBioGuy 04 July 2013 09:18:27PM 7 points [-]

Am i theonly onewho does not see an anthropic shadow there? All i see is a few widely scattered huge events and finer resolution on smaller more recent events...

Comment author: satt 04 July 2013 10:36:34PM 5 points [-]

I assume they're referring to the top right quadrant of the graph being totally empty while the top left quadrant has two events. But those two events are a pretty slender reed to rest their analysis on.

What looks more interesting to me is an apparent downward trend in the biggest crater size from Chixhulub onwards. I tried downloading the Earth Impact Database data referenced in the paper so I could zoom in on these more recent impacts, but the dataset's only available as machine-unreadable HTML tables with various ad hoc notations. (This leads me to wonder how Ćirković, Sandberg & Bostrom turned these clunky tables of numbers into an unambiguous scatterplot, and makes me even more nervous about those two data points on which their analysis hinges.)

Comment author: faul_sname 05 July 2013 11:05:47PM *  7 points [-]
Comment author: satt 08 July 2013 07:23:03PM *  3 points [-]

Whee! Thanks. I won't ask how the sausage was made; I'll just plunge right into the graphs.

[N.B.: this is the third set of plots I've made, having overhauled them twice in response to errors pointed out by the child comments. The second round of plots, which erroneously used log-log scales, are at this link and this link.]

Here's my version of the Ćirković, Sandberg & Bostrom plot.

Impact crater diameter against age to ~2400 Ma

There appears to be even less evidence of anthropic shadow than in their original graph; there's now an impact in the upper right quadrant, and if anything more mid-sized craters are recorded more recently. But the latter could be a reporting bias because there are better records for newer impacts. So let's zoom in on that denser period:

Impact crater diameter against age to ~600 Ma

Still no sign of anthropic shadowing. What about zooming in on the post-Chicxulub period I originally wondered about?

Impact crater diameter against age to ~65 Ma

I think there's actually mild evidence of anthropic shadowing at this scale, although visually that's mostly suggested by the three biggest craters. Even ignoring those, though, there does seem to be a sort of downward wedge in crater sizes.

And lastly, a link to a bonus plot of the most recent period, the last 3 million years, during which Homo was evolving. I think there's no visible evidence of anthropic shadowing on that plot, which doesn't surprise me much because there're so few opportunities for anthropic shadowing to appear on such a short time scale.

I think these corrected plots bring me back to where I was when I first read ĆS&B's paper: open to the idea of anthropic shadowing, but seeing only a faint sign of it in the impact crater data.

(The R code [for the old plots].)

Comment author: Unnamed 09 July 2013 07:34:46AM 3 points [-]

The log scale creates that downward-sloping pattern as an artifact - it appears even if the craters are purely random (uniformly distributed across time).

Simplified example: suppose that we treat crater diameter as binary, with a 10km or more crater counting as a "big crater" and anything smaller getting ignored. If we get one "big crater" every 2 Myr, on average, then we'd expect the right half of the x-axis to be blank; the rightmost datapoint would be around the 1 Myr mark. Between 1-10 Myr we'd expect to see a few dots (4-5 big impacts). To the left of the 10 Myr mark, the dots would get denser and denser; there would be hundreds of them between 100 & 1000 Myr.

If we instead chose a smaller cutoff for what counts as a "bit crater" - say, a once every 0.2 Myr sized crater (which is perhaps a 2km diameter) - then the pattern would look the same, but shifted over to the right (by one tick mark, in that case).

In the two-dimensional log-log graph, that pattern (of increasing density to the left of the graph, petering out at different x-values depending on what size crater you're looking for) translates into the downward slope that we see here.

Comment author: satt 10 July 2013 11:19:47PM 0 points [-]

Good point. Come to think of it, that's probably why ĆS&B used a linear scale for the time axis in the first place.

Comment author: faul_sname 08 July 2013 07:48:06PM 3 points [-]

I think the 10^7 Myr one is an error, seeing as the earth is less than 10^4 Myr old.

Comment author: satt 08 July 2013 08:30:52PM *  2 points [-]

You're absolutely right, can't believe I missed that. That datum's the Dhala crater in India, which has its age listed as "> 1700 < 2100" Ma. Dropping the angle brackets and the spaces gave "17002100". The three other data points over 2400 Ma (the "Jebel Waqf as Suwwan", "Tunnunik (Prince Albert)", and "Amelia Creek" craters) got misdated for similar reasons. Better fix the data file and replot. One sec....

Edit: fixed those four points, but I now notice there's a Santa Fe crater that's mis-sized at 613 km instead of "6-13".

Edit 2: OK, think that's rectified as well. If anyone's wondering how I handled these ranges, I did the lazy thing and took the arithmetic mean of the upper & lower bounds.

Comment author: Douglas_Knight 05 July 2013 05:32:22AM -2 points [-]

machine-unreadable HTML tables

The whole point of HTML is to be machine-readable. I find that if I copy a table from Apple's web browser and paste it into Apple's spreadsheet, it works fine. Maybe you need better machines.

Comment author: satt 05 July 2013 11:09:20AM 1 point [-]

Upvoted for the impressive feat of cramming Apple fanboyism and subtly flawed linguistic pedantry into three dozen words of double-barrelled flamebait. Downvoted for posting double-barrelled flamebait comprising Apple fanboyism and subtly flawed linguistic pedantry.

machine-unreadable HTML tables

The whole point of HTML is to be machine-readable.

That HTML's meant to be machine-readable doesn't mean it is. (Both webpages and browsers can fail to meet HTML standards.) But that is itself a counter-nitpick. The bigger problem with your nitpick is that you're reading "machine-readable" in a blinkered way. As Wikipedia says, "machine-readable" data can refer to "human-readable data that is marked up so that it can also be read by machines (examples; microformats, RDFa) or data file formats intended principally for machines (RDF, XML, JSON)". You seem to have only the first meaning in mind while I was thinking of the second. I wanted the data in a format that a computer could immediately interpret and turn into a scatterplot, such as a text file of two tab-delimited columns of numbers. Now, you do make the point that it's fairly straightforward to get the data as two columns of numbers...

I find that if I copy a table from Apple's web browser and paste it into Apple's spreadsheet, it works fine. Maybe you need better machines.

...but telling me this is unhelpful. For one thing, I already have two spreadsheet programs on my computer that can do the same thing, Gnumeric and OpenOffice.org Calc. For another, why should I have to change my usual workflow (paste data into vim, clean it, save as plain text, load into R, make graphs) when the data could've been made available in a simple format in the first place? Lastly, once you've got the numbers into your spreadsheet, what happens when you try plotting them? Do you still "find that [...] it works fine"? I suspect not, because the age numbers include values like "< 0.001", "0.004 ± 0.001", "0.0054± 0.0015", "~ 0.0066", "> 0.05", ">5, <36", and "3-95". Being able to circumvent the clunkiness of presenting data in HTML tables doesn't eliminate the problem of the ad hoc human-readable-but-machine-unreadable notations.

Comment author: Douglas_Knight 05 July 2013 12:50:42PM 0 points [-]

why should I have to change my usual workflow

By that standard, an excel spreadsheet is "machine-unreadable."

Comment author: satt 05 July 2013 07:18:19PM 0 points [-]
Comment author: oooo 05 July 2013 05:53:26AM 1 point [-]

Maybe you need better machines.

This should be one of the LW Rationality Quotes for next month.

Comment author: CarlShulman 05 July 2013 07:04:46AM 1 point [-]

Against the rules.

Comment author: Luke_A_Somers 06 July 2013 04:35:28PM 0 points [-]

Interpret it as a wish that it could be, then?

Comment author: ciphergoth 05 July 2013 12:43:46PM 0 points [-]

ISTR we once had a rationality quotes thread with the reverse rule, but I can't find it now!

Comment author: oooo 05 July 2013 07:55:08AM 0 points [-]

This will teach me to skim next time. Thanks.