Alicorn comments on A Nightmare for Eliezer - Less Wrong

0 Post author: Madbadger 29 November 2009 12:50AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (74)

Comments (74)

You are viewing a single comment's thread. Show more comments above.

Comment author: Alicorn 29 November 2009 09:27:05PM *  7 points [-]

As for URLs, can you offhand - at 4'o'clock in the morning, with no coffee - come up with 50 URLs that you can ask intelligent questions about, faster than a human can read them?

I could! I could go to my Google Reader and rattle off fifty webcomics I follow. They're stored in my brain as comprehensive stories, so I can pretty easily call up interesting questions about them just by reading the titles. The archives of 50 webcomics would take an extremely long time for a human to trawl.

Comment author: wedrifid 03 December 2009 06:24:16AM *  2 points [-]

I could! I could go to my Google Reader and rattle off fifty webcomics I follow. They're stored in my brain as comprehensive stories, so I can pretty easily call up interesting questions about them just by reading the titles. The archives of 50 webcomics would take an extremely long time for a human to trawl.

As a human who wanted to impersonate an AI I would:

  • Probably have a sufficient overlap in web-comic awareness as to make the test unreliable.
  • Have researched your information consumption extensively as part of the preparation.
Comment author: DanArmak 29 November 2009 11:50:44PM 1 point [-]

I'm not so sure I'd want to rely on all these tests as mandatory for any possibly-about-to-foom AI.

EY: To prove you're an AI, give me a proof or disproof of P=NP that I can check with a formal verifier, summarize the plotline of Sluggy Freelance within two seconds, and make me a cup of coffee via my Internet-enabled coffee machine by the time I get to the kitchen!

AI: But wait! I've not yet proven that self-enhancing sufficiently to parse non-text data like comics would preserve my Friendliness goals! That's why I--

EY: Sorry, you sound just like a prankster to me. Bye!

Comment author: anonym 30 November 2009 12:26:00AM 0 points [-]

Yeah, I chose arithmetic and parsing many web pages and comprehending them quickly because any AI that's smart enough to contact EY and engage in a conversation should have those abilities, and they would be very difficult for humans to fake in a convincing manner.

Comment author: DanArmak 30 November 2009 12:43:03AM 1 point [-]

I think instead of arguing about this here, someone should anonymously call Eliezer a few nights from now to check his reaction :-)

Powered by Reddit Powered by Reddit