JoshuaZ comments on [Link] The Dominant Life Form In the Cosmos Is Probably Superintelligent Robots - Less Wrong

2 Post author: Gunnar_Zarncke 20 December 2014 12:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (28)

You are viewing a single comment's thread. Show more comments above.

Comment author: advancedatheist 20 December 2014 03:11:24PM 5 points [-]

The Superintelligent Robot in My Garage, in other words. These conjectures for why ET's have to exist, but we haven't observed them yet, sound increasingly desperate and crazy. People hold on to this belief any way because the advanced ET has become a place-filler for the gods and demons we've recently believed in.

Comment author: JoshuaZ 21 December 2014 04:00:07PM *  4 points [-]

The absence of apparent intelligent life is a serious issue. It has nothing to do with believing in gods or demons, but is a real problem that we need to figure out the cause for. If the Great Filter is behind us, there's no serious issue. If the Great Filter is in front of us, then we need to be very concerned. These are deep questions that also have practical implications. The fact that the particular explanation from the article isn't a very good one is incidental.

Comment author: [deleted] 22 December 2014 06:12:50AM 4 points [-]

The Great Filter provides no explanation here. There are four options: early filter, late filter, multiple (early and late) filters, and no filters. In the first three cases the existence of early filters is explanation for an empty sky. (We are getting very close to the capability to build von Neuman probes though, so I'm not sure an o sky is evidence for a late filter.) In the case of no filter however, we can expect that any intelligence would start expanding into the universe at near the speed of light. So the fact that our light cone doesn't contain other intelligences, so far as we can see, is also consistent with no filter. An observation which is evidence for a proposition being both true and false doesn't provide any useful evidence.

Comment author: RobbBB 24 December 2014 07:34:27AM 5 points [-]

In the 'there's no filter, and colonization bubbles just expand too rapidly for other organisms to get advance warning' scenario, there's a fairly small window of time between 'the first organisms evolve' and 'no more organisms evolve ever again'. But in the absence of an early filter, that small window should occur early in the universe's lifespan, not late. The fact that we live in an old universe suggests that there must be an early filter of some sort (particularly if colonization is easy).

Comment author: [deleted] 28 December 2014 04:31:01PM 0 points [-]

The universe is a big, big place. It also becomes isolated relatively fast due to accelerating inflationary effects. There will probably be many intelligences out there even our most distant descendants will never meet.

Ultimately though you're making assumptions about the prior distribution of intelligent life which isn't warranted with a sample size of 1.

Comment author: lavalamp 04 January 2015 04:36:54PM 1 point [-]

An extremely low prior distribution of life is an early great filter.

Comment author: Punoxysm 23 December 2014 06:47:45PM 4 points [-]

We are getting very close to the capability to build von Neuman probes though, so I'm not sure an o sky is evidence for a late filter.

I am highly skeptical of this statement.

We haven't built a machine that can get out of our solar system and land on a planet in another.

We haven't made machines that can copy themselves terrestrially.

Making something that can get out of the solar system, land on another planet, then make (multiple) copies of itself seems huge leap beyond either of the other two issues.

Even an AGI that could self-replicate might have enormous difficulty getting to another planet and turning its raw resources into copies of itself.

Comment author: [deleted] 28 December 2014 04:34:20PM *  0 points [-]

But an AGI wouldn't be an AGI if it wasn't able to figure out how to solve the problem of getting from here to there and using in-situ resources to replicate itself. I hate to make arguments from definitions, but that's kinda the case here. If an intelligence can't solve that solvable problem, it really isn't a general intelligence now is it?

So how far are we from making an (UF)AGI? 15 years? 50 years? 100 years? That's still a cosmic blink in the eye.

Comment author: Wes_W 28 December 2014 05:58:48PM 2 points [-]

But an AGI wouldn't be an AGI if it wasn't able to figure out how to solve the problem of getting from here to there and using in-situ resources to replicate itself.

It remains to be seen whether we humans can do that. Does this mean we might not be general intelligences, either? That seems like a slightly silly and very nonstandard way to use the term.

Comment author: [deleted] 29 December 2014 06:31:29AM 0 points [-]

Eh... read up on the literature. Pay special attention to studies done by the British Interplanetary Society and the Advanced Automation in Space NASA workshop in the 80's, not to mention all the work done by early space advocates, some published, some not.

We can say with some confidence that we know how to do something even if it hasn't yet been reduced to practice or yet practially demonstrated. 19th century thinkers showed how rockets could in principle be built to enable human exploration of space. And they were right, pretty much on every point -- we still use and cite their work today.

We have done enough research on automated exploration and kinematic self-replicating machines* to say that it is definitively possible (life being an example), and within our reach if we had pockets and conviction deep enough to create it.

Comment author: Wes_W 29 December 2014 06:43:47AM *  1 point [-]

We can say with some confidence that we know how to do something even if it hasn't yet been reduced to practice or yet practially demonstrated.

Right, I'm objecting to the claim that

pockets and conviction deep enough to create it.

are included by definition when we say "general intelligence". (That, or I'm totally misunderstanding you.)

Comment author: [deleted] 29 December 2014 07:09:04AM 0 points [-]

You must be misunderstanding me, because what you just said seems like a total non-sequitur. What does pockets and deep conviction have to do with general intelligence indeed?

Comment author: Wes_W 29 December 2014 07:35:34AM *  0 points [-]

Starting with a rhetorical question was probably a bad idea. Let me try again:

But an AGI wouldn't be an AGI if it wasn't able to figure out how to solve the problem of getting from here to there and using in-situ resources to replicate itself.

I don't think this is true. An AGI which - due to practical limitations - cannot eat its future light cone can still be generally intelligent. Humans are potentially an example (minus the "artificial", but that isn't the relevant part).

Claiming that general intelligence can eat the universe by definition seems to suffer the same problem as the Socrates/hemlock question. It would mean we can't call something generally intelligent until we see it able to eat the universe, which would require not just theoretical knowledge but also the resources to pull it off. And if that's the requirement, then human general intelligence is an open question and we'd have zero known examples of general intelligence.

This does not seem to fit how we'd like to use the term to point to "the kind of problem-solving humans can do", so I think it's a bad definition.

(AGI can probably eat the universe, but that's more like a theorem than a definition.)

Comment author: JoshuaZ 23 December 2014 04:08:34PM 0 points [-]

In the case of no filter however, we can expect that any intelligence would start expanding into the universe at near the speed of light.

Questionable premise. It isn't at all clear how close one can get to the speed of light, and even if this were occurring at 10% of the speed of light rather 99% the situation would look drastically different.

Comment author: jacob_cannell 22 December 2014 05:30:27AM *  -2 points [-]

The Great Filter dogma has a number of problems.

If you start with any reasonable universe simulation model prior and sample it to get a prior probability distribution over habitable planets forming - you get lots and lots of them. You would need enormous evidence - like actually searching all of the galaxy - to overcome this prior.

Furthermore, we need to factor in universe selection in the multiverse. Biophilic universes can probably engineer space-time by creating artificial new universes - effectively shaping the prior probability distribution over the entire multiverse. (even if the physics of this seem low probability, it amplifies itself from nothing) Thus, life is far far more likely than it otherwise should be, because life is a necessary component of replicating universes, and replicating universes dominate the multiverse.

And finally, the entire idea of the great filter is based on an extremely specific and low probability model of future evolution of superintelligent civilization - dyson spheres and other nonsense.

See my reply here. Basically entropy/temperature is computational stupidity, and advanced civilizations need to move into a low entropy environment (like the intergalactic medium), becoming cold dark matter.

Comment author: JoshuaZ 23 December 2014 04:21:10PM *  3 points [-]

If you start with any reasonable universe simulation model prior and sample it to get a prior probability distribution over habitable planets forming - you get lots and lots of them

You don't need anything so fancy to get this conclusion. Empirical data and very basic models suggest that there are a lot of planets.

You would need enormous evidence - like actually searching all of the galaxy - to overcome this prior.

This does not follow, since you don't what the probabilities of other aspects other than habitable planets arising are. Moreover, we have effectively searched far beyond just one galaxy: if civilizations are common then they aren't doing anythng at all to show that: there's no sighn of stellar lifting, building Dyson spheres, or anything else that looks unnatural. That's a serious problem. We live in a universe that apparently has a lot of life bearing planets and the evidence shows that there's very little large-scale civilization. So what should one conclude?

Biophilic universes can probably engineer space-time by creating artificial new universes

"Probably" This means what? Why is this even a located hypothesis? Why should a universe being likely to have lots life be a universe more likely to have more new universes?

effectively shaping the prior probability distribution over the entire multiverse. (even if the physics of this seem low probability, it amplifies itself from nothing)

This is assuming an extremely strong form of multiverse, not just one that has differences in the fundamental constants of physics (questionable itself) but ones where the laws of physics themselves can divege. I see no good reason to assume such. Moreover, if one considers anything like that to be likely, it makes the situation even worse, because it is another reason to expect to see lots of civilizations, which we don't.

And finally, the entire idea of the great filter is based on an extremely specific and low probability model of future evolution of superintelligent civilization - dyson spheres and other nonsense.

Calling something nonsense doesn't make it go away. And yes, any specific construction may or may not occur- but the idea that civilizations exist and are leaving massive amounts of energy to go completely to waste requires an explanation. One should be worried when one is labeling stellar engineering as "nonsense" while taking engineering new universes in a broad multiverse setting as given. One of these is much closer to the established laws of physics.

See my reply here. Basically entropy/temperature is computational stupidity, and advanced civilizations need to move into a low entropy environment (like the intergalactic medium), becoming cold dark matter.

This is at best confused. Yes, doing operations takes energy. But you'd still rather use the available energy to do computations. There's no point in wasting it. As for the idea that this somehow involves "cold dark matter"- you are claiming that they are doing their computations made out of what exactly? Hidden MACHOs?