You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

John_Maxwell_IV comments on Some alternatives to “Friendly AI” - Less Wrong Discussion

19 Post author: lukeprog 15 June 2014 07:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (44)

You are viewing a single comment's thread.

Comment author: John_Maxwell_IV 15 June 2014 10:48:52PM 5 points [-]

I found an old SIAI mailing list email thread (from 2009) on this topic. (Individuals involved in the thread: Tim Freeman, Vincent Fagot, Anna Salamon.)

Comment author: John_Maxwell_IV 16 June 2014 08:06:05AM 7 points [-]

Highlights not already present in this thread:

  • Safely scalable AI

  • Humane AI

  • Benevolent AI

  • Moral AI

Comment author: Douglas_Reay 18 July 2014 08:15:14AM -1 points [-]

I like "scalable". "Stability" is also an option for conveying that it is the long term outcome of the system that we're worried about.

"Safer" rather than "Safe" might be more realistic. I don't know of any approach in ANY practical topic, that is 100% risk free.

And "assurance" (or "proven") is also an important point. We want reliable evidence that the approach is as safe as the designed claim.

But it isn't snappy or memorable to say we want AI whose levels of benevolence have been demonstrated to be stable over the long term.

Maybe we should go for a negative? "Human Extinction-free AI" anyone? :-)