You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Luke_A_Somers comments on [link] Etzioni: AI will empower us, not exterminate us - Less Wrong Discussion

4 Post author: CBHacking 11 December 2014 08:51AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread. Show more comments above.

Comment author: Luke_A_Somers 11 December 2014 12:31:49PM 2 points [-]

It's not even formally correct. An autonomous AI does not need to create its own terminal goals*, and the will we give it is perfectly adequate to screw us over.

  • if it can't create instrumental goals it's not strong enough to worry about
Comment author: Gunnar_Zarncke 11 December 2014 10:47:23PM 0 points [-]

Probably we disagree about what intelligence is. If intelligence is the ability to follow goals in the presence of obstancles the question becomes trivial. If intelligence is the ability to effectively find solutions in a given complex search space then little follows. It depends you the AI is decomposed into action and planning components and where the feedback cycles reside.