brainoil comments on Is my view contrarian? - Less Wrong

22 Post author: lukeprog 11 March 2014 05:42PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (94)

You are viewing a single comment's thread. Show more comments above.

Comment author: brainoil 31 March 2014 02:52:28AM 1 point [-]

This is a false analogy. You can be a believer in God when you're five years old and haven't read any relevant arguments due to childhood indoctrination that happens in every home. You might even believe in income redistribution when you're five years old if your parents tell you that it's the right thing to do. I'm pretty sure nobody teaches their children about UFAI that way. You'd have to know the arguments for or against UFAI to even know what that means.

Comment author: RichardKennaway 31 March 2014 07:29:46PM 1 point [-]

You'd have to know the arguments for or against UFAI to even know what that means.

You just have to watch the Terminator movies, or the Matrix, or read almost any science fiction with robots in it. The UFness of AI is a default assumption in popular culture.

Comment author: christopherj 01 April 2014 04:18:35AM 1 point [-]

It's more complicated than that. We use (relatively incompetent) AIs all over the place, and there is no public outcry, even as we develop combat AI for our UAVs and ground based combat robots, most likely because everyone thinks of AIs as merely idiot-savant servants or computer programs. Few people think much about the distinction between specialized AIs and general AI, probably because we don't actually have any general AI, though no doubt they understand that the simpler AI "can't become self-aware".

People dangerously anthropomorphize AI, expecting it by default to assign huge values to human life (huge negative values in the case of "rogue AI"), with a common failure mode of immediate and incompetent homicidal rampage while being plagued by various human failings. Even general AIs are viewed as being inferior to humans in several aspects.

Overall, there is not a general awareness that a non-friendly general AI might cause a total extinction of human life due to apathy.

Comment author: Lumifer 31 March 2014 07:51:02PM 2 points [-]

The UFness of AI is a default assumption in popular culture.

This is true. On the other hand, the default is for the AI to be both unfriendly and stupid. Notice, for example, the complete inability of the Matrix overlords to make their agents hit anything they're shooting at :-D