Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

TuviaDulin comments on Failed Utopia #4-2 - Less Wrong

53 Post author: Eliezer_Yudkowsky 21 January 2009 11:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (248)

Sort By: Old

You are viewing a single comment's thread.

Comment author: TuviaDulin 01 April 2012 06:57:32PM 2 points [-]

When the critical 90% threshold is reached and the AI self-destructs, will there be anything left behind to ensure human safety? He said that the world he created will remain in his wake, but will it be able to maintain itself without his sentient oversight? Is there any completely reliable mechanism that could prevent ecological collapse, or a deadly mutation in the catgirls/boys, or a failure in the robots that protect people from harm?

If not, then the clever fool who created the AI was really, really a fool. You'd think he'd have at least included a contingency that makes the AI reset everything back to the way it was before it self-destructs....