Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

ialdabaoth comments on Sympathetic Minds - Less Wrong

24 Post author: Eliezer_Yudkowsky 19 January 2009 09:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (25)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: ialdabaoth 25 March 2013 01:33:52AM 2 points [-]

If you meet a maximizer, open fire in lieu of "hello".

Which is why a "Friendly" AI needs to be a meta-maximizer, rather than a mere first-order maximizer. In order for an AI to be "friendly", it needs to recognize a set of beings whose utility functions it wishes to maximize, as the inputs to its own utility function.