You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

torekp comments on Recent AI safety work - Less Wrong Discussion

20 Post author: paulfchristiano 30 December 2014 06:19PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (6)

You are viewing a single comment's thread.

Comment author: torekp 10 January 2015 01:05:57PM 0 points [-]
  1. We might try to write a program that doesn’t pursue a goal, and fail. Issue [2] sounds pretty strange—it’s not the kind of bug most software has. But when you are programming with gradient descent, strange things can happen.

I found this part of Optimization and goals very helpful for thinking about Tool AI - thanks.