JonahSinick comments on Tiling Agents for Self-Modifying AI (OPFAI #2) - Less Wrong

55 Post author: Eliezer_Yudkowsky 06 June 2013 08:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (260)

You are viewing a single comment's thread. Show more comments above.

Comment author: JonahSinick 02 July 2013 02:28:19PM 1 point [-]

I don't really understand how "task specific algorithms generated by humans" differs from general intelligence. Humans choose a problem, and then design algorithms to solve the problem better. I wouldn't expect a fundamental change in this situation (though it is possible).

All I'm saying here is that general intelligence can construct algorithms across domains, whereas my impression is that impressive human+ artificial intelligence to date hasn't been able to construct algorithms across domains.

General artificial intelligence should be able to prove:

  1. The Weil conjectures
  2. The geometrization conjecture,
  3. Monstrous Moonshine
  4. The classification of simple finite groups
  5. The Atiyah Singer Index Theorem
  6. The Virtual Haken Conjecture

and thousands of other such statements. My impression is that current research in AI is analogous to working on proving these things one at a time.

Working on the classification of simple finite groups could indirectly help you prove the Atiyah-Singer Index Theorem on account of leading to the discovery of structures that are relevant, but such work will only make a small dent on the problem of proving the Atiyah-Singer Index Theorem. Creating an algorithm that can prove these things (that's not over-fitted to the data) is a very different problem from that of proving the theorems individually.

Do you think that the situation with AI is analogous or disanalogous?

A single algorithm currently achieves the best known approximation ratio on all constraint satisfaction problems with local constraints (this includes most of the classical NP-hard approximation problems where the task is "violate as few constraints as possible" rather than "satisfy all constraints, with as high a score as possible"), and is being expanded to cover increasingly broad classes of global constraints.

I'm not sure if I follow. Is the algorithm that you have in mind the conglomeration of all existing algorithms?

If so, it's entirely unclear how quickly the algorithm is growing relative to the problems that we're interested in.

Comment author: paulfchristiano 03 July 2013 08:24:38AM 3 points [-]

I'm not sure if I follow. Is the algorithm that you have in mind the conglomeration of all existing algorithms?

No, there is a single SDP rounding scheme that gets optimal performance on all constraint satisfaction problems (the best we know so far, and the best possible under the unique games conjecture).

Comment author: JonahSinick 03 July 2013 06:38:00PM 2 points [-]

Can you give a reference?

Comment author: paulfchristiano 03 July 2013 10:53:30PM 3 points [-]
Comment author: lukeprog 07 July 2013 09:58:31PM 1 point [-]
Comment author: JonahSinick 03 July 2013 06:41:22PM 0 points [-]

I'd be interested in your thoughts on this discussion post.

Comment author: jsteinhardt 03 July 2013 05:45:53AM 2 points [-]

I would disagree with the statement that our algorithms are all domain-specific. Often some amount of domain-specific knowledge is needed to design a good algorithm, but it is often quite minimal. For instance, my office-mate is building a parser for interpreting natural language semantics, and has taken zero linguistics classes (but has picked up some amount of linguistics knowledge from talks, etc.). Of course, he's following in the footsteps of people who do know linguistics, but the point is just that the methods people use tend to be fairly general despite requiring task-specific tuning.

I agree, of course, that there are few systems that work across multiple domains, but I'm not sure that that's a fundamental issue so much as a symptom of broader issues that surface in this context (such as latent variables and complex features).

Comment author: JonahSinick 03 July 2013 06:40:56PM 1 point [-]

Thanks Jacob. I'd be interested in your thoughts on this discussion post.