timtyler comments on My true rejection - Less Wrong

-16 Post author: dripgrind 14 July 2011 10:04PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (45)

You are viewing a single comment's thread.

Comment author: timtyler 14 July 2011 10:54:27PM *  -1 points [-]

Long before a Friendly AI is developed, some research team is going to be in a position to deploy an unFriendly AI that tries to maximise the personal wealth of the researchers, or the share price of the corporation that employs them, or pursues some other goal that the rest of humanity might not like.

And who's going to stop that happening?

That is a fairly likely outcome. It would represent business as usual. The entire history of life is one of some creatures profiting at the expense of other ones.

Comment author: dripgrind 14 July 2011 11:36:11PM -1 points [-]

My point, then, is that as well as heroically trying to come up with a theory of Friendly AI, it might be a good idea to heroically stop the deployment of unFriendly AI.

Comment author: timtyler 15 July 2011 06:46:28AM *  0 points [-]

Very large organisations do sometimes attempt to cut of their competitors' air supply.

They had better make sure they have good secrecy controls if they don't want it to blow up in their faces.