Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Caledonian2 comments on High Challenge - Less Wrong

22 Post author: Eliezer_Yudkowsky 19 December 2008 12:51AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (72)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Caledonian2 19 December 2008 05:11:23PM 0 points [-]

Or, to put it another way:

"Fixing" the future, in a way that renders human beings completely redundant and unnecessary even to themselves, isn't fixing anything. It's creating a problem of unlimited scope.

If that's the ultimate outcome of, say, producing superhuman minds - whether they're somehow enslaved to human preferences or not - then we're trying very hard to create a world in which the only rational treatment of humanity is extinction. Whether imposed from without or from within, voluntarily, is irrelevant.