Qiaochu_Yuan comments on Tiling Agents for Self-Modifying AI (OPFAI #2) - Less Wrong

55 Post author: Eliezer_Yudkowsky 06 June 2013 08:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (260)

You are viewing a single comment's thread. Show more comments above.

Comment author: Qiaochu_Yuan 06 June 2013 06:03:07PM *  6 points [-]

I’m not sure why this should be high on the priority list of general AI issues to think about it.

I don't think it's the highest-priority issue to think about, but my impression is that among the issues that Eliezer has identified as worth thinking about, it could be the one closest to being completely mathematically formalized, so it's a good one to focus on for the purpose of getting mathematicians interested in MIRI.

Comment author: Nick_Beckstead 06 June 2013 06:16:23PM 1 point [-]

I do appreciate arguments in favor of focusing your effort on tractable problems, even if they are not the most important problems to solve.

It's certainly hard to answer the question, "Why is this the best project to work on within AI?" since it implicitly requires comparisons will all types of stuff. It's probably unreasonable to ask Eliezer to answer this question in a comment. However, it is reasonable to ask, "Why will this research help make machine intelligence develop in a way that will benefit humanity?" Most of the other questions in my comment are also relevant to that question.