mwengler comments on Morality open thread - Less Wrong

6 Post author: Will_Newsome 08 July 2012 02:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (86)

You are viewing a single comment's thread. Show more comments above.

Comment author: Trevor_Caverly 09 July 2012 04:27:01AM 0 points [-]

Summary: I'm wondering whether anyone (especially moral anti-realists) would disagree with the statement, "The utility of an agent can only depend on the mental state of that agent".

I have had little success In my attempts to devise a coherent moral realist theory of meta-ethics, and am no longer very sure that moral realism is true, but there is one statement about morality that seems clearly true to me. "The utility of an agent can only depend on the mental state of that agent". Call this statement S. By utility I roughly mean how good or bad things are, from the perspective of the agent. The following thought experiment gives a concrete example of what I mean by S.

Imagine a universe with only one sentient thing, a person named P. P desires that there exist a 1 meter cube of gold somewhere within P's lightcone. P has a (non-sentient) oracle that ey trusts completely to provide either an accurate answer or no information for whatever question ey asks. P asks it whether a 1 meter gold cube exists within eir lightcone, and the oracle says yes.

It seems clear that whether the cube actually exists cannot possibly be relevant to the utility of P, and therfore the utility of the universe. P is free to claim that eir utility depends upon the existence of the cube, but I believe P would be mistaken. P certainly desires the cube to exist, but I believe that it cannot be part of P's utility function. (I suppose it could be argued that in this case P is also mistaken about eir desire, and that desires can only really be about one's own metnal state, but that's not important to my argument). Similarly, P would be mistaken to claim that anything not part of eir mind was part of eir utility function.

I'm not sure whether S in itself implies a weak form of moral realism, since it implies that statements of the form "x is not part of P's utility function" can be true. Would these statements count as ethical statements in the necessary way? It does not seem to imply that there is any objective way to compare different possible worlds though, so it doesn't hurt the anti-realist position much. Still, it does seem to provide a way to create a sort of moral partition of the world, by breaking it into individual morally relevant agents (no, I don't have a good definition for "morally relevant agent") which can be examined separately, since their utility can only depend on their map of the world and not the world itself. The objective utility of the universe can only depend on the separate utilities in each of the partitions. This leaves the question of whether it makes any sense to talk about an objective utility of the universe.

So, does anyone disagree with S? If you agree with S, are you an anti-realist?

Comment author: mwengler 09 July 2012 09:54:10PM 1 point [-]

So, does anyone disagree with S? If you agree with S, are you an anti-realist?

I disagree with S and I think you might also. It depends on how you define utility.

Consider two sentiences, P&Q. They are in identical states of mind. However, they are not in identical states of universe. P is in a room which is about to have its exits sealed and will then be slowly filled with an acid solution which will eat the flesh from P's bones, killing him after about 45 minutes of excruciating pain. Q is in a room in which a screening of the movie "Cabaret" starring Liza Minelli, Robert York, and Joel Grey is about to begin.

But at this moment, neither acid nor movie has started, and P & Q are in the same state of mind. By your definition of utility do they have the same utility?

I disagree with S. I have no idea if agreeing with S makes you an anti-realist, but it does seem to indicate you are underestimating the power of reality to make you unhappy.

Comment author: Trevor_Caverly 09 July 2012 10:17:54PM -1 points [-]

I guess the realism aspect isn't as relevant as I thought it would be. I expected that any realists would believe S, and that anti-realists might or might not. I also think that not believing S would imply anti-realism, but I'm not super confident that that's true.

I would say that P and Q have equal utility until the point where their circumstances diverge, after which of course they would have different utilities. There is no reason to consider future utility when talking about current utility. So it just depends on what section of time you are looking at. If you're only looking at a segment where P and Q have identical brain states, then yes I would say they have the same utility.