Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

vi21maobk9vp comments on I think I've found the source of what's been bugging me about "Friendly AI" - Less Wrong Discussion

8 Post author: ChrisHallquist 10 June 2012 02:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (31)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 10 June 2012 02:19:01PM *  9 points [-]

Edit: It's now fixed.

A non-doomsday machine (the AI "for which no wish is safe.")

In Eliezer's quote, "genies for which no wish is safe" are those that kill you irrespective of what wish you made, while here it's written as if you might be referring to AIs that are safe even if you make no wish, which is different. This should be paraphrased for clarity, whatever the intended meaning.

Comment author: vi21maobk9vp 10 June 2012 02:22:48PM 7 points [-]

Or maybe the parenthesis refere only to "doomsday machine"

Comment author: evand 10 June 2012 03:16:32PM 4 points [-]

That's how I read it. The wording could be clearer.

Comment author: ChrisHallquist 11 June 2012 07:02:38AM 0 points [-]

This is the intended reading. Edited for clarity.