You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Logos01 comments on Wanted: "The AIs will need humans" arguments - Less Wrong Discussion

7 Post author: Kaj_Sotala 14 June 2012 11:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (83)

You are viewing a single comment's thread. Show more comments above.

Comment author: stcredzero 14 June 2012 07:18:28PM 2 points [-]

Come to think of it a suicidal AI could be a pretty big problem...

It's probably been thought of here and other places before, but I just thought of the "Whoops AI" -- a superhuman AGI that accidentally or purposefully destroys the human race, but then changes its mind and brings us back as a simulation.

Comment author: Logos01 14 June 2012 10:48:15PM -2 points [-]

but then changes its mind and brings us back as a simulation."

This is commonly referred to as a "counterfactual" AGI.