Jack comments on Morality is not about willpower - Less Wrong

9 Post author: PhilGoetz 08 October 2011 01:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (144)

You are viewing a single comment's thread. Show more comments above.

Comment author: PhilGoetz 06 October 2011 02:56:05PM *  -1 points [-]

This is all true. But humans do not have utility functions... Humans are not the coherent, consistent agents you make them out to be.

If you think that's relevant, you should also go write the same comment on Eliezer's post on utilons and fuzzies. Having two coherent, consistent utility functions is no more realistic than having one.

If you want to be rational, you need to try to figure out what your values are, and what your utility function is. Humans don't act consistently. Whether their preferences can be described by a utility function is a more subtle question whose answer is unknown. But in either case, in order to be more rational, you need to be able to approximate your preferences with a utility function.

Fighting for willpower is basically your far-self trying to wrest control of your behavior from your near-self.

You can alternately describe this as the place where the part of your utility function that you call your far self, and the part of your utility function that you call your near self, sum to zero and provide no net information on what to do. You can choose to describe the resultant emotional confusion as "fighting for willpower". But this leads to the erroneous conclusions I described under the "ethics as willpower" section.

Comment author: Jack 08 October 2011 09:14:13AM 3 points [-]

Just to clarify I am not, not, not defending the willpower model you described-- I just don't think willpower, properly understood as a conflict between near and far modes can be left out of an account of human decision making processes. I think the situation is both more complicated and more troubling than both models and don't think it is rational to force the square peg that is human values into the round hole that is 'the utility function'.

Comment author: PhilGoetz 08 October 2011 03:05:28PM 0 points [-]

I'll agree that willpower may be a useful concept. I'm not providing a full model, though - mostly I want to dismiss the folk-psychology close tie between willpower and morals.