You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

AlexMennen comments on Cynical explanations of FAI critics (including myself) - Less Wrong Discussion

21 Post author: Wei_Dai 13 August 2012 09:19PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (49)

You are viewing a single comment's thread. Show more comments above.

Comment author: AlexMennen 14 August 2012 12:28:07AM 5 points [-]

I hear Eliezer is planning to start writing a sequence on open problems in Friendly AI soon.

Comment author: shminux 14 August 2012 02:17:03AM 2 points [-]

That's a different task... I'd expect to see something like "in phase one we plan to do this during this timeframe, next, depending on the outcome of phase one, we plan to proceed along the following lines, which we expect will take from m to n years...", rather than a comprehensive list of all open problems. The latter is hard and time consuming, the former is something that should not take longer than a page written down, at least as a first draft.

Comment author: Kaj_Sotala 14 August 2012 08:15:04AM 7 points [-]

I don't think it would be reasonable to develop such a roadmap at this point, given that it would require having a relatively high certainty in a specific plan. But given that it's not yet clear whether the best idea is to proceed on being the first one to develop FAI, or to pursue one of the proposals listed in the OP, or to do something else entirely, and furthermore it's not even clear how long it will take to figure that out, such specific roadmaps seem impossible.

Comment author: shminux 14 August 2012 03:09:22PM 2 points [-]

And this vagueness pattern-matched perfectly to various failed undertakings, hence my skepticism.

Comment author: DaFranker 16 August 2012 03:26:45PM 2 points [-]

In my model, it also pattern-matches with "Fundamental research that eventually gave us Motion, Thermodynamics, Relativity, Transistors, etc."

Comment author: AlexMennen 14 August 2012 04:21:34AM *  0 points [-]

This looks somewhat like what you're asking for, although it does leave a bit to be desired.

Comment author: shminux 14 August 2012 06:09:14AM *  2 points [-]

No, it does not at all look like a roadmap. This is a roadmap. Concrete measurable goals. The strategic plan has no milestones and no timelines.

Comment author: Luke_A_Somers 14 August 2012 02:00:57PM 6 points [-]

Timelines don't work very well on such slippery topics. You work at it until you're done. Milestones are no less necessary, for sure.