You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

lukeprog comments on Anyone have any questions for David Chalmers? - Less Wrong Discussion

11 Post author: Solvent 10 March 2012 09:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (26)

You are viewing a single comment's thread. Show more comments above.

Comment author: lukeprog 11 March 2012 08:29:30AM 12 points [-]

The response Anna and I give in our forthcoming chapter "Intelligence Explosion: Evidence and Import" is the following:

Chalmers (2010) suggested that AI will lead to intelligence explosion if an AI is produced by an "extendible method," where an extendible method is "a method that can easily be improved, yielding more intelligent systems." McDermott (2012a, 2012b) replies that if P≠NP (see Goldreich 2010 for an explanation) then there is no extendible method. But McDermott's notion of an extendible method is not the one essential to the possibility of intelligence explosion. McDermott's formalization of an "extendible method" requires that the program generated by each step of improvement under the method be able to solve in polynomial time all problems in a particular class — the class of solvable problems of a given (polynomially step-dependent) size in an NP-complete class of problems. But this is not required for an intelligence explosion in Chalmers' sense (and in our sense). What intelligence explosion (in our sense) would require is merely that a program self-improve to vastly outperform humans, and we argue for the plausibility of this in section 3 of our chapter. Thus while we agree with McDermott that it is probably true that P≠NP, we do not agree that this weighs against the plausibility of intelligence explosion. (Note that due to a miscommunication between McDermott and the editors, a faulty draft of McDermott (2012a) was published in Journal of Consciousness Studies. We recommend reading the corrected version at http://cs-www.cs.yale.edu/homes/dvm/papers/chalmers-singularity-response.pdf.)

I sent this to Drew and he said he agreed with our rebuttal.

Comment author: antigonus 11 March 2012 06:48:21PM 0 points [-]

Do you feel this is a full rebuttal to McDermott's paper? I agree that his generalized argument against "extendible methods" is a straw man; however, he has other points about Chalmers' failure to argue for existing extendible methods being "extendible enough."

Comment author: lukeprog 11 March 2012 07:45:18PM 2 points [-]

No, our paragraph does not rebut everything we disagree with in McDermott's paper. Chalmers' reply in the forthcoming "The Singularity: a reply" is adequate.

Comment author: antigonus 12 March 2012 03:38:18AM 0 points [-]

I suppose I'd like to hear Solvent ask him about those.

Comment author: Solvent 11 March 2012 11:13:35AM 0 points [-]

Do you mean "I sent this to Chalmers and he said he agreed with our rebuttal."?

Comment author: lukeprog 11 March 2012 12:05:52PM *  10 points [-]

No. I sent the rebuttal to Drew McDermott, and Drew McDermott agreed with our rebuttal of Drew McDermott.

Comment author: Normal_Anomaly 12 March 2012 01:55:57PM 5 points [-]

Good for Drew McDermott!

Comment author: Solvent 12 March 2012 02:13:50AM -2 points [-]

Sure.