Will_Pearson comments on Hot Air Doesn't Disagree - Less Wrong

8 Post author: Eliezer_Yudkowsky 16 August 2008 12:42AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (45)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Will_Pearson 16 August 2008 04:07:08PM 0 points [-]

Okay lets say morality is like primality. What happens if I get morality wrong? If my ability to test primes is faulty my encryptions are more likely to be broken and I will give 5 presents to my 3 nephews and expect them to be able to divide them evenly, causing familial tension. The latter example would still be true even if societies primality detection is broken. What are the consequences if I and society get morality wrong? Lets say society thinks it is not immoral to kill babies under 6 months (not that it is a good thing to do, but neutral). What effects would the evil actions have, such that we could recognise them and potentially correct our morality detection?