whpearson comments on Back of the envelope calculations around the singularity. - Less Wrong

3 Post author: whpearson 15 January 2010 12:14AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (24)

You are viewing a single comment's thread. Show more comments above.

Comment author: whpearson 15 January 2010 06:49:44PM 0 points [-]

The short version: AI that uses experimentation (as well as proof) to navigate through the space (or sub spaces) of turing machines in its internals.

Experimentation implies to me things like compartmentalization of parts of the AI in order to contain mistakes, potential conflict between compartments as they haven't been proved to work well together. So vaguely brain-like.

Comment author: timtyler 16 January 2010 12:29:02PM 0 points [-]

I.e. provable correctness.

We can already see fairly clearly how crippling a limitation that is. Ask a robot builder whether their software is "provably correct" and you will likely get laughed back into kindergarden.