You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Unknowns comments on [link] Etzioni: AI will empower us, not exterminate us - Less Wrong Discussion

4 Post author: CBHacking 11 December 2014 08:51AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread. Show more comments above.

Comment author: Unknowns 11 December 2014 10:36:25AM 0 points [-]

A general problem solver already has "goals", since it already is a physical object with behavior in the world: there are things that it does and things that it does not do. So it is not clear that you can simply take a general problem solver and make it into a program that "makes trains run on time" ; the goal of making the trains run on time will come into conflict the general problem solver's own "goals" (behavior), just as when we try to pursue some goal such as "save the world" this comes into conflict with our own preexisting goals such as getting food and so on.

Comment author: Kawoomba 11 December 2014 11:11:49AM 1 point [-]

Once general AI exists, there will be ones for basically all economic activity everywhere. Unlike humans which require a generation to train, and which are kind of hard to reprogram (even using North Korean methods), with AI once you got the code you can just fork() off a new one, with the goals changed as desired (or not...).