You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Mark_Friedenbach comments on What are your contrarian views? - Less Wrong Discussion

10 Post author: Metus 15 September 2014 09:17AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (806)

You are viewing a single comment's thread.

Comment author: [deleted] 21 September 2014 02:59:19AM *  5 points [-]

[Please read the OP before voting. Special voting rules apply.]

The necessary components of AGI are quite simple, and have already been worked out in most cases. All that is required is a small amount of integrative work to build the first UFAI.

Comment author: Azathoth123 21 September 2014 08:35:03PM 1 point [-]

What do you mean by that. Technical all that is required is the proper arrangement of transistors.

Comment author: [deleted] 21 September 2014 10:44:32PM 1 point [-]

I mean that the component pieces such as planning algorithms, logic engines, pattern extractors, evolutionary search, etc. have already been worked out, and that there exist implementable designs for combining these pieces together into an AGI. There aren't any significant known unknowns left to be resolved.

Comment author: Azathoth123 23 September 2014 01:47:58AM 3 points [-]

Then where's the AI?

Comment author: [deleted] 23 September 2014 01:59:15AM *  3 points [-]

All the pieces for bitcoin were known and available in 1999. Why did it take 10 years to emerge?

Comment author: [deleted] 26 September 2014 01:47:00AM 0 points [-]

I don't see anything in there about a goal system -- not even one that optimizes for paperclips. Goetzel and his lot are dualists and panpsychists: how can we expect them to complete a UFAI when they turn to mysticism when asked to design its soul?

Comment author: Lumifer 21 September 2014 11:14:43PM 0 points [-]

the component pieces such as planning algorithms, logic engines, pattern extractors, evolutionary search, etc. have already been worked out, and that there exist implementable designs for combining these pieces together into an AGI.

So, um, what's the problem, then?

Comment author: [deleted] 22 September 2014 02:58:36AM 2 points [-]

So, um, what's the problem, then?

There are no problems. UFAI could be constructed by a few people who know what they are doing on today's commodity hardware with only a few years effort.

Comment author: RichardKennaway 22 September 2014 11:03:58AM 1 point [-]

The outside view on this is that such predictions have been made since the start of A(G)I 50 or 60 years ago, and it's never panned out. What are the inside-view reasons to believe that this time it will? I've only looked through the table of contents of the Goertzel book -- is it more than a detailed survey of AGI work to date and speculations about the future, or are he and his co-workers really onto something?

Comment author: [deleted] 22 September 2014 03:37:20PM *  2 points [-]

My prediction / contrarian belief is that they are really onto something, with caveats (did you look at the second book? that's where their own design is outlined).

At the very highest level I think their CogPrime design is correct in the sense that it implements a human-level or better AGI that can solve many useful categories of real world problems, and learn / self-modify to solve those categories it is not well adapted to out of the box.

I do take issue with some of the specific choices they made in both fleshing out components and the current implementation, OpenCog. For example I think using the rule-based PLN logic engine was a critical mistake, but at an architectural level that is a simple change to make since the logic engine is / should be loosly coupled to the rest of the design (it's not in OpenCog, but c'est la vie. I think a rewrite is necessary anyway for other reasons). I'd swap it out for a form of logical inference based on Bayesian probabalistic graph models a la Pearl. There are various other tweaks I would make regarding the atom space, sub-program representation, and embodiment. I'd also implement the components within the VM language of the AI itself, such that it is able to self-modify its own core capabilities. But at the architectural level these are tweaks of implementation details. It's remains largly the same design outlined by Goertzel et al.

AI has been around for almost 60 years. However AGI as a discipline was invented by Goertzel et al only in the last 10 to 15 years or so. The story before that is honestly quite a bit more complex, with much of the first 50 years of AI being spent working on the sub-component projects of an integrative AGI. So without prototype solutions to the component problems, I don't find it at all surprising that progress was not made on integrating the whole.

Comment author: Lumifer 22 September 2014 04:51:34AM 0 points [-]

UFAI could be constructed by a few people who know what they are doing on today's commodity hardware with only a few years effort.

Any evidence for that particular belief?

Comment author: [deleted] 22 September 2014 05:14:30AM 0 points [-]

What do you think is missing from the implementation strategy outlined in Goertzel's Engineering General Intelligence?

Comment author: Lumifer 22 September 2014 06:08:06AM 0 points [-]

Haven't read it, but I'm guessing a prototype..?

Comment author: [deleted] 22 September 2014 06:20:32AM 0 points [-]

If you had that then you wouldn't need a few years to implement it now would you.