NancyLebovitz comments on Open Thread September, Part 3 - Less Wrong

2 Post author: LucasSloan 28 September 2010 05:21AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (203)

You are viewing a single comment's thread. Show more comments above.

Comment author: ShardPhoenix 01 October 2010 10:15:23AM *  3 points [-]

An example might be binary search, which is pretty trivial conceptually but which took many years for a correct, bug-free algorithm to be published.

e.g. see: http://googleresearch.blogspot.com/2006/06/extra-extra-read-all-about-it-nearly.html where a bug in a popular published version of the search remained undetected for decades.

This kind of thing is particularly worrying in the context of AI, which may well need to be exactly right the first time!

Comment author: NancyLebovitz 01 October 2010 02:33:26PM 0 points [-]

That's terrifying in the context of get-it-right-the-first-time AI.

I hope there will be some discussion of why people think it's possible to get around that sort of unknown unknown, or at best, barely niggling on the edge of consciousness unknown.