You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

blacktrance comments on Two kinds of population ethics, and Current-Population Utilitarianism - Less Wrong Discussion

7 Post author: AlexMennen 17 June 2014 10:26PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (21)

You are viewing a single comment's thread.

Comment author: blacktrance 18 June 2014 01:30:14AM 2 points [-]

They program their AI to maximize the average of everyone's experiential utility, plus half of Charlie's experiential utility, plus a trillionth of the sum of everyone's experiential utility.

It's important to note that each of them only agrees to this if they get more of whatever they want than they would without agreement. So if any of them can build their own AI, or expects to further their ends better with no AI than with the compromise AI, there's no agreement at all.