Vladimir_Nesov comments on Let's reimplement EURISKO! - Less Wrong

19 Post author: cousin_it 11 June 2009 04:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (151)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 11 June 2009 08:27:01PM 7 points [-]

Not exactly, Thom. Roughly, for FAI you need precise self-modification. For precise self-modification, you need a precise theory of the intelligence doing the self-modification. To get to FAI you have to walk the road that leads to precise theories of intelligence - something like our present-day probability theory and decision theory, but more powerful and general and addressing issues these present theories don't.

Eurisko is the road of self-modification done in an imprecise way, ad-hoc, throwing together whatever works until it gets smart enough to FOOM. This is a path that leads to shattered planets, if it were followed far enough. No, I'm not saying that Eurisko in particular is far enough, I'm saying that it's a first step along that path, not the FAI path.

Comment author: Vladimir_Nesov 11 June 2009 08:47:34PM *  2 points [-]

Well, in this sense computing is also a first step on that path, Moore's law of mad science and all. Eurisko in particular doesn't seem to deserve more mention than that.

Comment author: [deleted] 12 June 2009 01:33:14AM 2 points [-]

Doesn't seem to deserve more mention than the creation of computing? Sure. But computing has already been created.

Comment author: derekz 12 June 2009 02:12:52AM 1 point [-]

Um, so has Eurisko.

Comment author: [deleted] 12 June 2009 02:33:30AM 6 points [-]

...indeed. It seems that I failed to figure out just what I was arguing against. Let me re-make that point.

As far as first steps along that path go, they have already been taken: we have gone from a world without computers to a world with one, and we can't reverse that. The logical place to focus our efforts would seem to be the next step which has not been taken, which could very well be reimplementing EURISKO. (Though it could also very well be running a neural net on a supercomputer or some guy making the video game "Operant Conditioning Hero".)

Comment author: steven0461 12 June 2009 03:26:00AM 1 point [-]

We have gone from a world without dictators to a world with one, and we can't reverse that. The logical place to focus our efforts would seem to be the next step which has not been taken, which could very well be resurrecting Hitler.

Comment author: thomblake 12 June 2009 03:11:54PM 8 points [-]

Seriously? I did not think a discussion of Eurisko could be Godwinned. Bravo.

Comment author: steven0461 12 June 2009 07:47:13PM 0 points [-]

While grandparent was probably a miscalculation of some sort, I feel that mentioning Hitler is more acceptable if the context is Nazi super science than outrage maximization.

Comment author: Nominull 12 June 2009 04:20:06PM 5 points [-]

Resurrecting Hitler would probably teach us a lot about medicine, actually. If we can generalize the process by which we resurrect Hitler, we could save a lot of lives.

Comment author: [deleted] 12 June 2009 03:54:23AM 1 point [-]

True, if resurrecting Hitler is a good idea and we can cause it to happen; if resurrecting Hitler is inevitable and we can ensure that he ends up being a good guy; or if resurrecting Hitler would be bad and we can prevent it from happening.