DanArmak comments on A Nightmare for Eliezer - Less Wrong

0 Post author: Madbadger 29 November 2009 12:50AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (74)

You are viewing a single comment's thread. Show more comments above.

Comment author: DanArmak 29 November 2009 11:50:44PM 1 point [-]

I'm not so sure I'd want to rely on all these tests as mandatory for any possibly-about-to-foom AI.

EY: To prove you're an AI, give me a proof or disproof of P=NP that I can check with a formal verifier, summarize the plotline of Sluggy Freelance within two seconds, and make me a cup of coffee via my Internet-enabled coffee machine by the time I get to the kitchen!

AI: But wait! I've not yet proven that self-enhancing sufficiently to parse non-text data like comics would preserve my Friendliness goals! That's why I--

EY: Sorry, you sound just like a prankster to me. Bye!

Comment author: anonym 30 November 2009 12:26:00AM 0 points [-]

Yeah, I chose arithmetic and parsing many web pages and comprehending them quickly because any AI that's smart enough to contact EY and engage in a conversation should have those abilities, and they would be very difficult for humans to fake in a convincing manner.

Comment author: DanArmak 30 November 2009 12:43:03AM 1 point [-]

I think instead of arguing about this here, someone should anonymously call Eliezer a few nights from now to check his reaction :-)