rwallace comments on What I would like the SIAI to publish - Less Wrong

27 Post author: XiXiDu 01 November 2010 02:07PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (218)

You are viewing a single comment's thread. Show more comments above.

Comment author: rwallace 02 November 2010 05:45:51PM 1 point [-]

The claim that AIs will foom, basically, reduces to the claim that the difficulty of making AGI is front-loaded

Yes.

the history of invention in general indicates that the first prototype is a major landmark after which the pace of development speeds up dramatically.

This is not actually true. The history of invention in general indicates that the first prototype accomplishes little, and a great deal of subsequent work needs to be done - even in the case of inventions like machine tools and computers that are used for creating subsequent generations of themselves.

Comment author: CarlShulman 04 November 2010 07:58:02PM 2 points [-]

Yes, this is right. Prototypes often precede widespread deployment and impact of a technology by decades until various supporting technologies and incremental improvements make them worth their costs.