You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

TheAncientGeek comments on Superintelligence 23: Coherent extrapolated volition - Less Wrong Discussion

5 Post author: KatjaGrace 17 February 2015 02:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (97)

You are viewing a single comment's thread. Show more comments above.

Comment author: TheAncientGeek 18 February 2015 03:51:18PM *  0 points [-]

Presumably you are assuming that societies judge their values by their values, always coming to the answer "we're good". But societies can do better and worse at realising their values. Movoer, socieites can judge moral values by non moral values, for instance by consistency. (Yudkowsky's habit, aparently copied by Bostrom, of refusing to distingusih moral value from non-moral value, causes problems, inasmuch as making the distinction solves problems).

I am not sure putting your values into practice counts as a moral value.

Comment author: KatjaGrace 20 February 2015 07:43:35PM 1 point [-]

When people talk about moral progress, I think they are rarely talking about better achieving their fixed values.

Comment author: TheAncientGeek 20 February 2015 10:16:30PM 1 point [-]

I think almost everybody makes a distinction between moral and nonmoral value. Stamp collectors value stamps, but don't think societies with a greater supply of stamps are morally better.