Wei_Dai comments on Reframing the Problem of AI Progress - Less Wrong

21 Post author: Wei_Dai 12 April 2012 07:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread. Show more comments above.

Comment author: Wei_Dai 13 April 2012 05:44:42PM *  1 point [-]

Publishing AI work would help increase credibility, but it's a costly way of doing so since it directly promotes AI progress. At least some mainstream AI researchers already take SIAI seriously. (Evidence: 1 2) So I suggest bringing better arguments to them and convincing them to lend further credibility.

Comment author: IlyaShpitser 14 April 2012 02:25:16AM *  2 points [-]

By the way, what counts as "AI progress?" Do you consider statistics and machine learning a part of "AI progress"? Is theoretical work okay? What about building self-driving cars or speech recognition software? Where is, as someone here would call it, the Shelling point?

Do you consider stopping "AI progress" important enough to put something on the line besides talking about it?

Comment author: Wei_Dai 14 April 2012 04:28:29AM 4 points [-]

You raise a very good question. There doesn't seem to be a natural Schelling point, and actually the argument can be generalized to cover other areas of technological development that wouldn't ordinarily be considered to fall under AI at all, for example computer hardware. So somebody can always say "Hey, all those other areas are just as dangerous. Why are you picking on me?" I'm not sure what to do about this.

Do you consider stopping "AI progress" important enough to put something on the line besides talking about it?

I'm not totally sure what you mean by "put something on the line" but for example I've turned down offers to co-author academic papers on UDT and argued against such papers being written/published, even though I'd like to see my name and ideas in print as much as anybody. BTW, realistically I don't expect to stop AI progress, but just hope to slow it down some.

Comment author: IlyaShpitser 29 April 2012 06:55:11PM *  -2 points [-]

My understanding of Shelling points is there are, by definition, no natural Shelling points. You pick an arbitrary point to defend as a strategy vs slippery slopes. In Yvain's post he picked an arbitrary %, I think 95.

There is a slippery slope here. Where will you defend?