You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Coscott comments on "Stupid" questions thread - Less Wrong Discussion

40 Post author: gothgirl420666 13 July 2013 02:42AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (850)

You are viewing a single comment's thread. Show more comments above.

Comment author: Coscott 13 July 2013 04:43:25PM 0 points [-]

I don't like average utilitarianism, and I wasn't even aware that most folks here did, but I still have a guess as to why.

For many people, average utilitarianism is believed to be completely unachievable. There is no way to discover peoples utility functions in a way that can be averaged together. You cannot get people to honesty report their utility functions, and further they can never even know them, because they have no way to normalize and figure out whether or not they actually care more than the person next to therm.

However, a sufficiently advanced Friendly AI may be able to discover the true utility functions of everyone by looking into everyone's brains at the same time. This makes average utilitarianism an actual plausible option for a futurist, but complete nonsense for a professional population ethicist.

This is all completely a guess.

Comment author: wedrifid 15 July 2013 12:08:23AM 2 points [-]

I don't like average utilitarianism, and I wasn't even aware that most folks here did, but I still have a guess as to why.

Most people here do not endorse average utilitarianism.

Comment author: kalium 14 July 2013 05:58:06AM 1 point [-]

This does not explain a preference for average utilitarianism over total utilitarianism. Avoiding the "repugnant conclusion" is probably a factor.

Comment author: Coscott 15 July 2013 01:38:54AM 0 points [-]

I didn't even consider total utilitarianism in my response. Sorry. I think you are right about the "repugnant conclusion".

Comment author: Kaj_Sotala 14 July 2013 07:30:52PM 1 point [-]

For many people, average utilitarianism is believed to be completely unachievable. There is no way to discover peoples utility functions in a way that can be averaged together.

I thought "average utiltarianism" referred to something like "my utility function is computed by taking the average suffering and pleasure of all the people in the world", not "I would like the utility functions of everyone to be averaged together and have that used to create a world".

Comment author: Coscott 15 July 2013 01:41:25AM 0 points [-]

I think you are correct. That is what I meant, but I see how I misused the word "utility." The argument translates easily. Without out AI, we don't have any way to measure suffering and pleasure.