SilasBarta comments on Crime and punishment - Less Wrong

39 Post author: PhilGoetz 24 March 2011 09:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (189)

You are viewing a single comment's thread. Show more comments above.

Comment author: SilasBarta 25 March 2011 01:53:20AM 1 point [-]

My article, "Morality as Parfitian-filtered decision theory?", was devoted to exactly that question, and my conclusion is that justice -- or at least the feeling that drives us to pursuit-of-justice actions -- is an instrumental value, even though such actions cause harm to our terminal values. This is because theories that attempt to explain such "self-sacrificial" actions by positing justice (or morality, etc.) as a separate term in the agent's utility function add complexity without corresponding explanatory power.

Comment author: Matt_Simpson 26 March 2011 05:48:31AM 1 point [-]

I skimmed the article. First, good idea. I would never have thought of that. But I do think there is a flaw. Given evolution, we would expect humans to have fairly complex utility functions and not simple utility functions. The complexity penalty for evolution + simple utility function could actually be higher than that of evolution + complicated utility function, depending on precisely how complex the simple and complicated utility functions are. For example, I assert that the complexity penalty for [evolution + a utility function with only one value (e.g. paper clips or happiness)] is higher than the complexity penalty for [evolution + any reasonable approximation to our current values].

This is only to say that a more complicated utility function for an evolved agent doesn't necessarily imply a high complexity penalty. You could still be right in this particular case, but I'm not sure without actually being able to evaluate the relevant complexity penalties.

Comment author: SilasBarta 28 March 2011 09:45:07PM 0 points [-]

That's a good point, and I'll have to think about it.