Trevor_Caverly comments on Morality open thread - Less Wrong

6 Post author: Will_Newsome 08 July 2012 02:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (86)

You are viewing a single comment's thread. Show more comments above.

Comment author: Trevor_Caverly 09 July 2012 03:15:06PM -1 points [-]

In your example, I agree that almost everyone would choose the second choice, but my point is that they will be worse off because they make that choice. It is an act of altruism, not an act which will increase their own utility. (Possibly the horror they would experience in making choice 1 would outweigh their future suffering, but after the choice is made they are definitely worse off having made the second choice.)

I say that the cube cannot be part of P's utility function, because whether the cube exists in this example is completely decoupled from whether P believes the cube exists, since P trusts the oracle completely, and the oracle is free to give false data about this particular fact. P's belief about the cube is part of the utility function, but not the actual fact of whether the cube exists.

Comment author: mwengler 09 July 2012 09:05:26PM 1 point [-]

It may not matter whether there is gold in them thar hills, but it does matter what the oracle says. So I think you have misstated P's utility function. P wants the oracle to tell him the gold exists, that is his utility function. And realizing that, you cannot say that it doesn't matter what the oracle really tells him, because it does.

I don't think P's hypothesized stupid reliance on a lying oracle binds us to ignore what P really wants and thus call it only a state of mind. He needs that physical communication from something other than his mind, the oracle.

Comment author: Trevor_Caverly 09 July 2012 09:28:21PM -1 points [-]

I am stipulating that P really truly wants the gold to exist (in the same way that you would want there not to exist a bunch of people who are being tortured, ceteris paribus). Whether P should be trusting the oracle is besides the point. The difference between these scenarios is that you are correct in believing that the people being tortured is morally bad. However, your well-being would not be affected by whether the people are being tortured, only by your belief of how likely this is. Of course, you would still try to stop the torture if you could, even if you knew that you would never know whether you were successful, but this is mainly an act of altruism.

My main point is probably better expressed as "Beings with identical mental states must be equally well off". Disagreeing with this seems absurd to me, but apparently a lot of people do not share this intuition.

Also, you could easily eliminate the oracle in the example by just stating that P spontaneously comes to believe the cube exists for no reason. Or we could imagine that P has a perfectly realistic hallucination of the oracle. The fact that P's belief is unjustified does not matter. According to S, the reasons for P's mental state are irrelevant.

Comment author: mwengler 09 July 2012 10:16:07PM 1 point [-]

Whether P should be trusting the oracle is besides the point.

No, it isn't. You are claiming that P "really" wants the gold to exist, but you are also claiming that P thinks that at least one of the definitions of "the gold exists" is "the oracle said the gold exists." You are flummoxed by the paradox of P feeling just as happy due to a false belief in gold as he would based on a true belief in gold, and you are ignoring the thing that ACTUALLY made him happy: which was the oracle telling him the gold was real.

How surprising should it be that ignoring the real world causes of something produces paradoxes? P's happiness doesn't depend the gold existing in reality, but it does believe on something in reality causing him to believe the gold exists. And if the gold doesn't exist in reality, P's happiness is not changed, but if the reality that lead him to believe the gold existed is reversed, if the oracle tells him (truly or falsely) the gold doesn't exist, then his happiness is changed.

I actually have not a clue what this example's connection to moral realism might be, either supporting it or denying it. But I am pretty clear that what you present as a "real mental result without a physical cause because the gold does not matter" is merely a case of you taking an hypothesized fool at his word and ignoring the REAL physical cause of P's happiness or sadness. Or from a slightly different tack, if P defined "gold exists" as "oracle tells me gold exists" then P's claim that his utility is the gold is equivaelnt to a claim that his utility is being told there is god.

Ps happiness has a real cause in the real world. Because P is an idiot, he misunderstands what that cause means, but even P recognizes that the cause of his happiness is what the oracle told him.

Comment author: Trevor_Caverly 09 July 2012 11:11:39PM -1 points [-]

No, it isn't. You are claiming that P "really" wants the gold to exist, but you are also claiming that P thinks that at least one of the definitions of "the gold exists" is "the oracle said the gold exists."

I do not claim that. I claim that P believes the cube exists because the oracle says so. He could believe it exists because he saw it in a telescope. Or because he saw it fly in front of his face and then away into space. Whatever reason he has for "knowing" the cube exists has some degree of uncertainty. He is happy because he has a strong belief that the gold exists. Moreover, my point stands regardless of where P gets his knowledge. Imagine, for example, that P believes strongly that the cube does not exist, because the existence of the cube violates Occam's razor. It is still the case (in my opinion) that whether he is correct does not alter his well-being.

How surprising should it be that ignoring the real world causes of something produces paradoxes?

I do not think that this is a paradox, it seems intuitively obvious to me. In fact, I'm not entirely sure that we disagree on anything. You say "P's happiness doesn't depend the gold existing in reality, but it does believe on something in reality causing him to believe the gold exists." I think others on this thread would argue that P's happiness does change depending on the existence of the gold, even if what the oracle tells him is the same either way.

I actually have not a clue what this example's connection to moral realism might be,

Maybe nothing, I just suspected that moral anti-realists would be less likely to accept S. My main question is just whether other people share my intuition that S is true (and what there reasons for agreeing or disagreeing are).

Ps happiness has a real cause in the real world. Because P is an idiot, he misunderstands what that cause means, but even P recognizes that the cause of his happiness is what the oracle told him.

I'm not sure I understand what you're saying. P believes that the oracle is telling him the cube exists because the cube exists. P is of course mistaken, but everything else the oracle told him was correct, so he strongly believes that the oracle will only tell him things because they are the truth. Whether this is a reasonable belief for P to have is not relevant. You seem to be saying that if something has no causal effect on someone, that it cannot affect their well-being. I agree with that, but other people do not agree with that.