army1987 comments on The Octopus, the Dolphin and Us: a Great Filter tale - Less Wrong

48 Post author: Stuart_Armstrong 03 September 2014 09:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (233)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 30 August 2014 02:36:58PM 4 points [-]

From the OP:

The real filter could be a combination of an early one and a late one, of course. But, unless the factors are exquisitely well-balanced, its likely that there is one location in civilizational development where most of the filter lies (ie where the probability of getting to the next stage is the lowest).

That's very non-obvious to me; I can't see why there couldn't be (say) a step with probability around 1e-12, one with probability around 1e-7, one with probability around 1e-5, one with probability around 1e-2, and a dozen ones with joint probability around 1e-1, so that no one step comprises the majority (logarithmically) of the filter.

Comment author: torekp 31 August 2014 12:46:12PM 2 points [-]

Good point, but note that in your example, the top filter does a lot more than the runner-up. There could be a lot of value in knowing what that top one is, even if the others combined are more important. (But that wouldn't answer the question, how much danger do we still face? Which may be the biggest question. So again - good point.)

Comment author: [deleted] 31 August 2014 07:53:40PM 7 points [-]

But that wouldn't answer the question, how much danger do we still face? Which may be the biggest question.

It is. But even there, I'm under the impression that many people are focussing on the answers “most of it” and “hardly any” neglecting everything in between.


A few possible hypotheses (where by “supercomputers” I mean ‘computation capabilities comparable to those available to people on Earth in 2014’):

  1. Nearly all the filter ahead. A sizeable fraction of all star systems have civilizations with supercomputers, and about one in 1e24 of them will take over their future light cone.

  2. Most of the filter ahead. There are about a million civilizations with supercomputers per galaxy in average, and about one in 1e18 of them will take over their future light cone.

  3. Halfway through the filter. There is about one civilization with supercomputers per galaxy in average, and about one in 1e12 of them will take over their future light cone.

  4. Most of the filter behind. There is about one civilization with supercomputers per million galaxies in average, and about one in a million of them will take over their future light cone.

  5. Nearly all of the filter behind. There have been few or no other civilizations with supercomputers than us in our past light cone, and we have a sizeable chance of taking over our future light cone.

ISTM people push too much of their probability mass near the ends and leave too little in the middle for some reason. (In particular, I'm under the impression that certain singularitarians unduly privilege hypothesis 5 just because they can't imagine a reason why we will fail to take over the future light cone -- which is way too Inside View for me -- and they think the only thing left to know is whether the takeover will be Good or Bad.)

I think there's pretty little practical difference between 3 and 4 (unless you value us taking over the future light cone at somewhere between 1e6 and 1e12, on some appropriate scale), and not terribly much between 1 and 4 either, so maybe people are conflating anything below 5 together and that's what they actually mean when they sound like they say 1?

(Of course there's 6. Planetarium hypothesis -- someone in our past light cone has already taken over their future light cone, but they don't want us to know for some reason or another -- but I don't think that more than 99.99% of possible superintelligences would give a crap about us inferior beings, so this can explain at most about one sixth of the filter. Just add “visibly” before “take over” everywhere above.)

Comment author: [deleted] 01 September 2014 10:00:56AM *  3 points [-]

BTW, I think that 1 is all but ruled out (and 2 is slightly disfavoured) by the failure of SETI (at least if you interpret the present tense to mean ‘as of the time their wordline intersects the surface of our past light cone’), and 5 is unlikely because of Moloch (if he's scary enough to stop cancer from killing whales he's totally likely to be scary enough to stop > 99.9% of civilizations with supercomputers from taking over the light cone).

My own probability distribution has a broad peak somewhere around 4 with a long-ish tail to the left.