skeptical_lurker comments on Why AGI is extremely likely to come before FAI - Less Wrong

4 Post author: skeptical_lurker 01 August 2012 10:22AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (29)

You are viewing a single comment's thread. Show more comments above.

Comment author: skeptical_lurker 01 August 2012 04:41:57PM 0 points [-]

Ok, they both tree search over a space, whether it is the space of strategies or the space of programs. That does make sense.

I think my initial reaction to SI was very negative - even without the halting problem, simply testing every program of length<n is crazy. By comparison, I could imagine some kind of tree search, possibly weighted by heuristics, to be efficient.

Comment author: gwern 01 August 2012 05:13:58PM 0 points [-]

I think my initial reaction to SI was very negative - even without the halting problem, simply testing every program of length<n is crazy.

It's crazy, but some universes are crazy. Pity the poor AI who wakes up inside a simulation where the programmer is in fact testing it on every program of length <n!

Comment author: skeptical_lurker 01 August 2012 05:58:43PM 0 points [-]

We could be in a simulation where the programmer is in fact testing it on every program of length <n! Doesn't seem so bad.