redding comments on Stupid Questions May 2015 - Less Wrong

10 Post author: Gondolinian 01 May 2015 05:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (263)

You are viewing a single comment's thread.

Comment author: redding 01 May 2015 10:32:19PM *  3 points [-]

One common way to think about utilitarianism is to say that each person has a utility function and whatever utilitarian theory you subscribe to somehow aggregates these utility functions. My question, more-or-less, is whether an aggregating function exists that says that (assuming no impact on other sentient beings) the birth of a sentient being is neutral. My other question is whether such a function exists where the birth of the being in question is neutral if and only if that sentient being would have positive utility.

EDIT: I do recall that a similar-seeming post: http://lesswrong.com/lw/l53/introducing_corrigibility_an_fai_research_subfield/

Comment author: DanielLC 02 May 2015 01:35:13AM 4 points [-]

If you try to do that, you get a paradox where, if A is not creating anyone, B is creating a new person and letting them lead a sad life, and C is creating a new person and letting them lead a happy life, then U(A) = U(B) < U(C) = U(A). You can't say that it's better for someone to be happy than sad, but both are equivalent to nonexistence.

Comment author: redding 02 May 2015 03:21:44PM 0 points [-]

Interesting. Do you have any idea why this results in a paradox, but not the corrigibility problem in general?