You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Gunnar_Zarncke comments on [link] Etzioni: AI will empower us, not exterminate us - Less Wrong Discussion

4 Post author: CBHacking 11 December 2014 08:51AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (11)
Tags: link etzioni ai

Comments (11)

You are viewing a single comment's thread. Show more comments above.

Comment author: Gunnar_Zarncke 11 December 2014 11:42:48AM -1 points [-]

The popular dystopian vision of AI is wrong for one simple reason: it equates intelligence with autonomy. That is, it assumes a smart computer will create its own goals, and have its own will (...)

The distinction is formally correct. But I agree that autonomy comes in very quickly by attaching a read-eval-print loop around the optimizer which takes the state of the world as input for the maximzation.

Comment author: Luke_A_Somers 11 December 2014 12:31:49PM 2 points [-]

It's not even formally correct. An autonomous AI does not need to create its own terminal goals*, and the will we give it is perfectly adequate to screw us over.

  • if it can't create instrumental goals it's not strong enough to worry about
Comment author: Gunnar_Zarncke 11 December 2014 10:47:23PM 0 points [-]

Probably we disagree about what intelligence is. If intelligence is the ability to follow goals in the presence of obstancles the question becomes trivial. If intelligence is the ability to effectively find solutions in a given complex search space then little follows. It depends you the AI is decomposed into action and planning components and where the feedback cycles reside.

Powered by Reddit Powered by Reddit