Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

timtyler comments on Max Tegmark on our place in history: "We're Not Insignificant After All" - Less Wrong

18 [deleted] 04 January 2010 12:02AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (68)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 05 January 2010 06:51:31PM 0 points [-]

Superintelligent agents can be expected to evolve out of systems that evolved by random mutations.

The systems that they evolved from can be expected to have goals that result in tracking down and utililising every available source of negentropy.

They will build superintelligent agents to help them attain these goals - and so the resulting systems are likely to be even better at tracking down and utilising negentropy than the original systems were - since they will pursue the same ends with greater competence.

Systems with radically different goals are not logically impossible. I call those "handicapped superintelligences". If they ever meet any other agents, it seems that they will be at a disadvantage - since nature disapproves of deviations from god's utility function.

Comment deleted 05 January 2010 07:24:24PM [-]