Luke_A_Somers comments on Why AI may not foom - Less Wrong

23 Post author: John_Maxwell_IV 24 March 2013 08:11AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (78)

You are viewing a single comment's thread. Show more comments above.

Comment author: Luke_A_Somers 26 March 2013 02:20:01AM 0 points [-]

I suppose it depends what you mean by 'smarter'. I mean, code optimizations are provable, and if Löb's theorem says you can't safely trim a million consecutive no-ops that somehow snuck into your inner loop, then it's a dumb theorem to use.

Developing new heuristics is a whole different kettle of fish and yes it's a rough-and-tumble world out there.

Comment author: Luke_A_Somers 26 March 2013 02:35:33PM 0 points [-]

Upon further reflection, it seems to me that the real upgrades are either going to be heuristics adopted in a continuous fashion on a Bayesian basis (software), or hardware.

And hardware contract proving is a much littler thing altogether. Basically, when DOES this theorem apply?