komponisto comments on The Strangest Thing An AI Could Tell You - Less Wrong

81 Post author: Eliezer_Yudkowsky 15 July 2009 02:27AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (574)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 15 July 2009 04:00:13AM *  28 points [-]

Here's some examples for your own consideration...

Bearing in mind, once again, that humans are known to be crazy in many ways, and that anosognosic humans become literally incapable of believing that their left sides are paralyzed, and that other neurological disorders seem to invoke a similar "denial" function automatically along with the damage itself. And that you've actually seen the AI's code and audited it and witnessed its high performance in many domains, so that you would seem to have far more reason to trust its sanity than to trust your own. So would you believe the AI, if it told you that:

1) Tin-foil hats actually do block the Orbital Mind Control Lasers.

2) All mathematical reasoning involving "infinities" implies self-evident contradictions, but human mathematicians have a blind spot with respect to them.

3) You are not above-average; most people believe in the existence of a huge fictional underclass in order to place themselves at the top of the heap, rather than in the middle. This is why so many of your friends seem to have PhDs despite PhDs supposedly constituting only 0.5% of the population. You are actually in the bottom third of the population; the other two-thirds have already built their own AIs.

4) The human bias toward overconfidence is far deeper than we are capable of recognizing; we have a form of species overconfidence which denies all evidence against itself. Humans are much slower runners than we think, muscularly weaker, struggle to keep afloat in the water let alone move, and of course, are poorer thinkers.

5) Dogs, cats, cows, and many other mammals are capable of linguistic reasoning and have made many efforts to communicate with us, but humans are only capable of recognizing other humans as capable of thought.

6) Humans cannot reproduce without the aid of the overlooked third sex.

7) The Earth is flat.

8) Human beings are incapable of writing fiction; all supposed fiction you have read is actually true.

Comment author: komponisto 15 July 2009 07:37:17AM 6 points [-]

So would you believe the AI, if it told you that:

2) All mathematical reasoning involving "infinities" implies self-evident contradictions, but human mathematicians have a blind spot with respect to them.

My answer would be no different if you replaced "infinities" with "manifolds" or "groups": Okay, please show me the contradiction.

3) You are not above-average

Yes.

1), 4)-8): These are all roughly on the order of "the world is a lie". In such cases I'd probably have to doubt my verification of the AI's calibration as well. So no, probably not.

Comment author: DanielLC 23 June 2014 05:05:46AM 2 points [-]

"My answer would be no different if you replaced "infinities" with "manifolds" or "groups": Okay, please show me the contradiction."

If I'm really worried about absolute denial, I might say "Okay, please show this automated proof-checker the contradiction".