Squark comments on Computation complexity of AGI design - Less Wrong

6 Post author: Squark 02 February 2015 08:05PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (69)

You are viewing a single comment's thread. Show more comments above.

Comment author: Squark 03 February 2015 06:28:41AM 1 point [-]

Hi Joshua, thx for commenting!

There is an enormous difference between my claim and what 27chaos is saying. 27chaos is suggesting that "maximizing human happiness" is computationally intractable. However, this is obviously not the case since humans maximize human values, or at least they do it to an extent which would be impressive in AI. My claim is that designing an AGI (finding the right program in the space of all possible programs) is computationally intractable. Once designed, the AGI itself is efficient, otherwise it wouldn't count as an AGI.

Comment author: JoshuaZ 03 February 2015 03:52:13PM 0 points [-]

Yes, I agree that what you are suggesting is different. I was pointing to the thread also because there's further discussion in the thread beyond 27chaos's initial point, and some of it is more relevant.

Comment author: Squark 05 February 2015 08:01:36AM 0 points [-]

I see. I would be grateful if you can point to specific comments you think are the most relevant.

Comment author: JoshuaZ 11 March 2015 07:47:30PM 1 point [-]

I would be grateful if you can point to specific comments you think are the most relevant.

At the risk of sounding egotistical, this bit seems relevant.

Comment author: Squark 13 March 2015 08:35:44AM 1 point [-]

Thanks, this is definitely relevant and thought provoking!