Eliezer_Yudkowsky comments on How does MIRI Know it Has a Medium Probability of Success? - Less Wrong

19 Post author: peter_hurford 01 August 2013 11:42AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (137)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 04 August 2013 04:53:28PM 1 point [-]

Which I said in the very same paragraph.

To clear up the ambiguity, does this mean you agree that I can do anything short of what von Neumann did, or that you don't think it's possible to get as far as independent judges favorably evaluating MIRI output, or is there some other standard you have in mind? I'm trying to get something clearly falsifiable, but right now I can't figure out the intended event due to sheer linguistic ambiguity.

I also think that evaluation by academics is a terrible test for things that don't come with blatant overwhwelming unmistakable undeniable-even-to-humans evidence - e.g. this standard would fail MWI, molecular nanotechnology, cryonics, and would have recently failed 'high-carb diets are not necessarily good for you'. I don't particularly expect this standard to be met before the end of the world, and it wouldn't be necessary to meet it either.

Comment author: CarlShulman 04 August 2013 07:43:23PM *  4 points [-]

To clear up the ambiguity, does this mean you agree that I can do anything short of what von Neumann did

As I said in my other comment, I would be quite surprised if your individual mathematical and AI contributions reach the levels of the best in their fields, as you are stronger verbally than mathematically, and discuss in more detail what I would find surprising and not there.

I also think that evaluation by academics is a terrible test for things that don't come with blatant overwhwelming unmistakable undeniable-even-to-humans evidence - e.g. this standard would fail MWI, molecular nanotechnology, cryonics, and would have recently failed 'high-carb diets are not necessarily good for you'.

I recently talked to Drexler about nanotechnology in Oxford. Nanotechnology is

  • Way behind Drexler's schedule, and even accounting for there being far less funding and focused research than he expected, the timeline skeptics get significant vindication
  • Was said by the NAS panel to be possible, with no decisive physical or chemical arguments against (and discussion of some uncertainties which would not much change the overall picture, in any case), and arguments against tend to be or turn into timeline skepticism and skepticism about the utility of research
  • Has not been the subject of a more detailed report or expert judgment test than the National Academy of Sciences one (which said it's possible) because Drexler was not on the ball and never tried. He is currently working with the FHI to get a panel of independent eminent physicists and chemists to work it over, and expects them to be convinced.