Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

ata comments on Rationality Quotes: April 2011 - Less Wrong

6 Post author: benelliott 04 April 2011 09:55AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (384)

You are viewing a single comment's thread. Show more comments above.

Comment author: ata 10 April 2011 06:23:27PM *  10 points [-]

Given complexity of value, 'evil giant' and 'good giant' should not be weighted equally; if we have no specific information about the morality distribution of giants, then as with any optimization process, 'good' is a much, much smaller target than 'evil' (if we're including apparently-human-hostile indifference).

Unless we believe them to be evolutionarily close to humans, or to have evolved under some selection pressures similar to those that produced morality, etc., in which we can do a bit better than a complexity prior for moral motivations.

(For more on this, check out my new blog, Overcoming Giants.)

Comment author: Psy-Kosh 10 April 2011 08:18:34PM 3 points [-]

Well, if by giants we mean "things that seem to resemble humans only are particularly big", then we should expect some sort of shared evolutionary history, so....