You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

passive_fist comments on The germ of an idea - Less Wrong Discussion

6 Post author: Stuart_Armstrong 13 November 2014 06:58PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread. Show more comments above.

Comment author: passive_fist 13 November 2014 10:29:29PM 3 points [-]

Nobody's presuming it has a 'personal agenda'. It's quite possible for it to think that it's just following our orders, when in fact it's become highly dangerous (see: paperclip maximizer). Come to think of it, this describes a lot of human history quite well.

I agree with the broader argument that paranoia won't solve anything. We should view the AI - no matter how complicated - as something that is just following a program (exactly like humans). Everything it does should be judged in the context of that program.

Comment author: cameroncowan 15 November 2014 01:28:21AM 0 points [-]

Who decides what that program is? What courses of actions should it take? Should that be a democratic process? Under the current system there would be no oversight in this area.

Comment author: ChristianKl 16 November 2014 11:02:32AM 0 points [-]

Who decides what that program is?

The person who creates it.

Comment author: cameroncowan 18 November 2014 04:12:53AM 0 points [-]

And that doesn't fill you with fear?