orthonormal comments on Ben Goertzel: The Singularity Institute's Scary Idea (and Why I Don't Buy It) - Less Wrong

32 Post author: ciphergoth 30 October 2010 09:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (432)

You are viewing a single comment's thread. Show more comments above.

Comment author: orthonormal 06 November 2010 01:15:10AM *  0 points [-]

Indeed. Before Darwin, design was a respectable-to-overwhelming hypothesis for the order of the natural world.

ETA: On second thought, that's too strong of a claim. See replies below.

Comment author: ata 06 November 2010 01:51:55AM *  1 point [-]

Is that true? If we went back in time to before Darwin and gave a not-already-religious person (if we could find one) a thorough rationality lesson — enough to skillfully weigh the probabilities of competing hypotheses (including enough about cognitive science to know why intelligence and intentionality are not black boxes, must carry serious complexity penalties, and need to make specific advance predictions instead of just being invoked as "God wills it" retroactively about only the things that do happen), but not quite enough that they'd end up just inventing the theory of evolution themselves — wouldn't they conclude, even in the absence of any specific alternatives, that design was a non-explanation, a mysterious answer to a mysterious question? And even imagining that we managed to come up with a technical model of an intelligent designer, specifying in advance the structure of its mind and its goal system, could it actually compress the pre-Darwin knowledge about the natural world more than slightly?

Comment author: Vaniver 06 November 2010 01:58:31AM 6 points [-]

Dawkins actually brings this up in The Blind Watchmaker (page 6 in my copy). Hume is given as the example of someone who said "I don't have an answer" before Darwin, and Dawkins describes it as such:

An atheist before Darwin could have said, following Hume: 'I have no explanation for complex biological design. All I know is that God isn't a good explanation, so we must wait and hope that somebody comes up with a better one.' I can't help feeling that such a position, though logically sound, would have left one feeling pretty unsatisfied, and that although atheism might have been logically tenable before Darwin, Darwin made it possible to be an intellectually fulfilled atheist. I like to think that Hume would agree, but some of his writings suggest that he underestimated the complexity and beauty of biological design."

Comment author: Perplexed 06 November 2010 02:59:10PM *  2 points [-]

Hume's Dialogues Concerning Natural Religion are definitely worth a read. And I think that Dawkins has it right: Hume really wanted a naturalistic explanation of apparent design in nature, and expected that such an explanation might be possible (even to the point of offering some tentative speculations), but he was honest enough to admit that he didn't have an explanation at hand.

Comment author: orthonormal 07 November 2010 05:14:01PM 0 points [-]

As pointed out below, Hume is a good counterexample to my thesis above.

Comment author: komponisto 06 November 2010 02:35:57PM 0 points [-]

On the other hand, there wasn't a whole lot of honest, systematic searching for other hypotheses before Darwin either.

Comment author: PhilGoetz 07 November 2010 02:48:45PM *  0 points [-]

I didn't really mean because of Darwin. Design is not a competitor to the theory of evolution. Evolution explains how complexity can increase. Design [ADDED: as an alternative to evolution] does not; it requires a designer that is assumed to be more complicated than the things it designs. Design explains nothing.

Comment author: Vladimir_Nesov 07 November 2010 02:55:04PM *  2 points [-]

Evolution explains how complexity can increase. Design does not; it requires a designer that is assumed to be more complicated than the things it designs. Design explains nothing.

Designers can well design things more complicated than they are. (If even evolution without a mind can do so, designers do that easily.)

Comment author: wedrifid 07 November 2010 04:32:37PM 0 points [-]

Agree. One way to look at it is that a designer can take a large source of complexity (whatever its brain is running on) and reshape and concentrate it into an area that is important to it. The complexity of the designer itself isn't important. Evolution does much the same thing.

Comment author: XiXiDu 07 November 2010 04:19:36PM 0 points [-]

I thought that the advance of scientific knowledge is an evolutionary process?

Comment author: wedrifid 07 November 2010 04:27:18PM 0 points [-]

I thought that the advance of scientific knowledge is an evolutionary process?

It is, literally. Although the usage of the term 'evolution' in this context has itself evolved such that has different, far narrower meaning here.

Comment author: timtyler 19 November 2010 08:37:41PM *  -1 points [-]

The term "evolution" usually means what it says in the textbooks on the subject.

They essentially talk about changes in the genetic make up of a population over time.

Science evolves in precisely that sense - e.g. see:

http://en.wikipedia.org/wiki/Dual_inheritance_theory

Comment author: wedrifid 19 November 2010 10:05:04PM 0 points [-]

I stand by my statement, leaving it unchanged.

Comment author: Vladimir_Nesov 07 November 2010 04:20:57PM 0 points [-]

Don't see how this remark is relevant, but here's a reply:
http://lesswrong.com/lw/l6/no_evolutions_for_corporations_or_nanodevices/

Comment author: Vladimir_M 07 November 2010 06:34:24PM *  1 point [-]

The main point of that post is clearly correct, but I think the example of corporations is seriously flawed. It fails to appreciate the extent to which successful business practices consists of informal, non-systematic practical wisdom accumulated through long tradition and selected by success and failure in the market, not conscious a priori planning. The transfer of these practices is clearly very different from DNA-based biological inheritance, but it still operates in such ways that a quasi-Darwinian process can take place.

Applying similar analysis to modern science would be a fascinating project. In my opinion, a lot of the present problems with the proliferation of junk science stem not from intentional malice and fraud, but from a similar quasi-Darwinian process fueled by the fact that practices that best contribute to one's career success overlap only partly with those that produce valid science. (And as in the case of corporations, the transfer of these practices is very different from biological inheritance, but still permits quasi-Darwinian selection for effective practices.)

Comment author: timtyler 19 November 2010 08:32:51PM 0 points [-]

The main point of that post is clearly correct [...]

The post is a denial of cultural evolution. For the correct perspective, see: Not By Genes Alone: How Culture Transformed Human Evolution by Peter J. Richerson and Robert Boyd.

Comment author: XiXiDu 07 November 2010 04:27:35PM 0 points [-]

I'd like to inquire about the difference between evolution and design regarding the creation of novelty. I don't see how any intelligence can come up with something novel that would allow it to increase complexity if not by the process of evolution.

Comment author: Vladimir_Nesov 07 November 2010 04:30:33PM *  0 points [-]

Noise is complexity. Complexity is easy to increase. Evolutionary designs are interesting not because of their complexity.

Comment author: PhilGoetz 07 November 2010 07:20:29PM *  0 points [-]

If your definition of complexity says noise is complexity, then you need a new definition of complexity.

Yes, many useful definitions, like entropy measures or Kolmogorov complexity, say noise is complexity. But people studying complexity recognize that this is a problem. They are aware that the phenomenon they're trying to get at when they say "complexity" is something different.

Comment author: Vladimir_Nesov 07 November 2010 07:31:53PM 0 points [-]

They are aware that the phenomenon they're trying to get at when they say "complexity" is something different.

And that concept of "complexity" is probably too complex to be captured by a fundamental notions such as K-complexity.

Comment author: XiXiDu 07 November 2010 04:43:59PM 0 points [-]

Well, I'm just trying to figure out what you tried to say when you replied to PhilGoetz:

Designers can well design things more complicated than they are.

Yes, but not without evolution. All that design adds to evolution is guidance. That is, if you took away evolution (this includes science and Bayesian methods) a designer could never design things more complicated (as in novel, as in better) than itself.

Comment author: Perplexed 07 November 2010 05:22:06PM -1 points [-]

N designers, each of complexity K, can collectively design something of maximum complexity NK, simply by dividing up the work.

Co-evolution, which may be thought of as a pair of designers interacting through their joint design product, and with an unlimited random stream as supplementary input, can result in very complex designs as well as in the designers themselves becoming more complex through information acquired in the course of the interaction.

It is amusing to look at the Roman Catholic theology of the Trinity, with this kind of consideration in mind. As I remember it, the Deity was "originally" a unipartite, simple God, who then became more complex by contemplating Himself and then further contemplating that Contemplation.

For this reason, I have never been all that impressed by the "refutation" of the first cause argument; the refutation being that it supposedly requires a complex "first cause" God, Who is Himself in need of explanation. God could conceivably have been simple (as simple as a Big Bang, anyways) and then developed (some people would prefer to say "evolved") under His own internal dynamics into something much more complex. Just as we atheists claim happened to the physical universe.

Comment author: DanArmak 07 November 2010 05:28:11PM 4 points [-]

For this reason, I have never been all that impressed by the "refutation" of the first cause argument; the refutation being that it supposedly requires a complex "first cause" God, Who is Himself in need of explanation. God could conceivably have been simple (as simple as a Big Bang, anyways) and then developed (some people would prefer to say "evolved") under His own internal dynamics into something much more complex. Just as we atheists claim happened to the physical universe.

Adapted refutation: if you're going to suppose a complex God evolving from a simpler one and then acting on the universe, it is simpler to suppose a complex universe evolving from a simple one. The refutation still holds based on Occam's razor.

Comment author: PhilGoetz 07 November 2010 07:24:05PM 0 points [-]

For this reason, I have never been all that impressed by the "refutation" of the first cause argument; the refutation being that it supposedly requires a complex "first cause" God, Who is Himself in need of explanation. God could conceivably have been simple (as simple as a Big Bang, anyways) and then developed (some people would prefer to say "evolved") under His own internal dynamics into something much more complex. Just as we atheists claim happened to the physical universe.

That simple "God" is the "God" of evolutionary theory. The "first mover" theory does require a complex first cause. It was made in ignorance of evolution, and assumes that a complex design requires an intelligent designer. Every last one of the defenders of the design theory denies that what you say is possible.

Comment author: Vladimir_Nesov 07 November 2010 06:15:02PM *  0 points [-]

N designers, each of complexity K, can collectively design something of maximum complexity NK, simply by dividing up the work.

What does it mean, exactly? (What's 'complexity'? What's 'something' that can be 'designed'?) Why do you believe it?

Comment author: timtyler 19 November 2010 08:29:43PM *  -2 points [-]

I thought that the advance of scientific knowledge is an evolutionary process?

Don't see how this remark is relevant, but here's a reply:

http://lesswrong.com/lw/l6/no_evolutions_for_corporations_or_nanodevices/

A wrong reply - for the correct answer, see:

Hull, D. L. 1988. Science as a Process. An Evolutionary Account of the Social and Conceptual Development of Science. The University of Chicago Press, Chicago and London, 586 pp.

Comment author: Vladimir_Nesov 19 November 2010 08:51:12PM *  2 points [-]

There are no correct answers in a dispute about definitions, only aesthetic judgments and sometimes considerations of the danger of hidden implicit inferences. You can't use authority in such an argument, unless of course you appeal to common usage.

However, referring to a book without giving an annotation for why it's relevant is definitely an incorrect way to argue (even if a convincing argument is contained therein).

Comment author: timtyler 19 November 2010 08:57:10PM -1 points [-]

Disputes about the definition of "evolution"? I don't think there are too many of those. Mark Ridley is the main one that springs to mind, but his definition is pretty crazy, IMHO.

Why the book is relevant appears to be already being made pretty explicit in the subtitle: "An Evolutionary Account of the Social and Conceptual Development of Science".

Comment author: soreff 07 November 2010 03:03:03PM 0 points [-]

Designers can well design things more complicated than they are.

Agreed. Also, there is a continuum from pure evolution (with no foresight at all) to evaluation of potential designs with varying degrees of sophistication before fabricating them. (I know that I'm recalling this from a post somewhere on this site - please excuse the absence of proper credit assignment.) An example of a dumb process which is marginally smarter than evolution is to take mutation plus recombination and then do a simple gradient search to the nearest local optimum before evaluating the design.

Comment author: wedrifid 07 November 2010 04:37:57PM 1 point [-]

Also, there is a continuum from pure evolution (with no foresight at all) to evaluation of potential designs with varying degrees of sophistication before fabricating them.

I'll add that evolution with DNA and sexual reproduction already in place fits on a different part of this continuum from evolution of the simplest replicators.

Comment author: XiXiDu 07 November 2010 04:35:23PM 0 points [-]

Designers can guide evolution but it is still evolution that creates novelty.

Whatever intelligence is, it can't be intelligent all the way down. It's just dumb stuff at the bottom. — Andy Clark

Intelligence is a process facilitated by evolution. Even an AGI making perfect use of some of our most novel algorithms wouldn't come up with something novel without evolution. See Bayesian Methods and Universal Darwinism.

Comment author: PhilGoetz 07 November 2010 03:57:23PM -1 points [-]

No; you are invoking the theory of evolution to give that credibility. Even post-Darwin, most people don't believe this is true. (Remember the Star Trek episode where Spock deduced something about a chess-playing computer, because "the computer could not play chess better than its programmer"?)

The religious advocates of Design explicitly denied this possibility; thus, their design story can't invoke it.

Comment author: Vladimir_Nesov 07 November 2010 03:58:41PM 0 points [-]

No; you are invoking the theory of evolution to give that credibility.

Incidentally, theory of evolution is true.

Comment author: Perplexed 07 November 2010 04:17:14PM -2 points [-]

I believe his point to be that an argument, to be effective, must be convincing to people who are not already convinced. Your argument offered the fact that evolution can design things more complicated than itself as an example with which to counter an anti-evolutionist argument. It therefore succeeds in convincing no one who was not already convinced.

Comment author: wedrifid 07 November 2010 04:35:45PM 0 points [-]

It therefore succeeds in convincing no one who was not already convinced.

It would, however, lead them to disagree for slightly different reasons.

Comment author: Perplexed 07 November 2010 04:52:26PM 0 points [-]

I don't understand your point.

Comment author: wedrifid 13 November 2010 02:13:27PM *  1 point [-]

It is not useless to demonstrate that you do not accept a premise rather than (as assumed) being unable see the obvious logical consequences of said premise. It would lead them to disagree for slightly different reasons. If any part of such conversation is about sharing understanding and seeking to communicate information then Vladmir's comment is, in fact, rather useful.

(No, it will not convince anyone who wasn't already convinced. But that is because people are just not convinced about religion by argument ever.)

Comment author: XiXiDu 13 November 2010 03:58:43PM *  1 point [-]

But that is because people are just not convinced about religion by argument ever.

"Believing this statement will make you happier."  -- Ryan Lortie

That's religion. A fairly good argument.

;-)

Comment author: orthonormal 07 November 2010 05:16:51PM 0 points [-]

Also missing from the world pre-1800: any understanding of complexity, entropy, etc.