Jonathan_Graehl comments on Humans are not automatically strategic - Less Wrong

153 Post author: AnnaSalamon 08 September 2010 07:02AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (266)

You are viewing a single comment's thread. Show more comments above.

Comment author: ciphergoth 08 September 2010 11:53:49AM 17 points [-]

Most basically, because humans are only just on the cusp of general intelligence.

This a point I've been thinking about a lot recently - that the time between the evolution of a species whose smartest members crossed the finish line into general intelligence, and today, is a blink of an eye in evolutionary terms, and therefore we should expect to find that we are roughly as stupid as it's possible to be and still have some of us smart enough to transform the world. You refer to it here in a way that suggests this is a well-understood point - is this point discussed more explicitly elsewhere?

It occurs to me that this is one reason we suffer from the "parochial intelligence scale" Eliezer complains about - that the difference in effect between being just barely at the point of having general intelligence and being slightly better than that is a lot, even if the difference in absolute capacity is slight.

I wonder how easy it would be to incorporate this point into my spiel for newcomers about why you should worry about AGI - what inferential distances am I missing?

Comment author: timtyler 08 September 2010 12:51:58PM *  6 points [-]
Comment author: Jonathan_Graehl 08 September 2010 11:11:29PM *  4 points [-]

I watched the end of this video and liked it quite a lot. Pretty good job, Eliezer. And thanks for the link.

And wow, the Q&A at the end of the talk has some tragically confused Q. And I'm sure these are people who consider themselves intelligent. Very amusing, and maddening.