You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Vaniver comments on Open thread, Oct. 5 - Oct. 11, 2015 - Less Wrong Discussion

7 Post author: MrMind 05 October 2015 06:50AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (346)

You are viewing a single comment's thread. Show more comments above.

Comment author: G0W51 05 October 2015 06:54:34AM *  6 points [-]

What literature is available on who will be given moral consideration in a superintelligence's coherent extrapolated volition (CEV) and how much weight each agent will be given?

Nick Bostrom's Superintelligence mentions that it is an open problem as to whether AIs, non-human animals, currently deceased people, etc should be given moral consideration, and whether the values of those who aid in creating the superintelligence should be given more weight than that of others. However, Bostrom does not actually answer these questions, other than slightly advocating everyone being given equal weight in the CEV. The abstracts of other papers on CEV don't mention this topic, so I am doubtful on the usefulness of reading their entireties.

(This is a repost.)

Comment author: Vaniver 05 October 2015 01:34:39PM 7 points [-]

What literature is available on who will be given moral consideration in a superintelligence's coherent extrapolated volition (CEV), and how much weight each agent will be given?

I don't think anyone has a satisfactory solution to what is inherently a political question, and I think people correctly anticipate that analyzing it through the lens of politics will lead to unsatisfying discussions.