cousin_it comments on Friendlier AI through politics - Less Wrong

1 Post author: Jonathan_Graehl 16 August 2009 09:29PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (41)

You are viewing a single comment's thread.

Comment author: cousin_it 16 August 2009 11:02:41PM *  6 points [-]

I found Brin's post flowery and worthless. Michael Anissimov correctly points out the problems with it in the comments. (Is he registered on LW, I wonder?)

People seem to have serious problems grasping the idea that AIs are machines that will stupidly want anything we program them to want, not elf-children that will magically absorb our "kindness" and "understanding". When I first came across Eliezer's writings about FAI, that point seemed absolutely obvious... I guess David Brin hasn't read it, that's about the only possible explanation.

Comment author: Dagon 17 August 2009 09:24:28PM 4 points [-]

Wait. AIs are neither of the things you say. they're not elf-children, but they're not stupid machines. They're smart machines, much like humans (but much faster to adapt).

It's very hard to believe that we will be able to understand the source code of a real AI any better than we understand our own or each others'. In that sense, yes - finding a way to include "kindness" and "empathy" as meta-values for the bootstrapping machine is exactly what some of us have in mind.

Comment author: Furcas 16 August 2009 11:06:02PM *  3 points [-]
Comment author: Jonathan_Graehl 17 August 2009 12:42:06AM 1 point [-]

I agree. I find his optimism refreshing (though probably still naive) when applied to humans, where at least there's some hope of his intuitions working, but I'm not sure that he's thought about AI deeply.