Anders_H comments on Rationality Quotes September 2014 - Less Wrong

8 Post author: jaime2000 03 September 2014 09:36PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (379)

You are viewing a single comment's thread. Show more comments above.

Comment author: KPier 27 September 2014 02:51:51AM *  29 points [-]

A shipowner was about to send to sea an emigrant-ship. He know that she was old, and not over-well built at the first; that she had seen many seas and climes, and often had needed repairs. Doubts had been suggested to him that possibly she was not seaworthy. These doubts preyed upon his mind and made him unhappy; he thought that perhaps he ought to have her thoroughly overhauled and refitted, even though this should put him to great expense. Before the ship sailed, however, he succeeded in overcoming these melancholy reflections. He said to himself that she had gone safely though so many voyages and weathered so many storms, that it was idle to suppose she would not come safely home from this trip also. He would put his trust in Providence, which could hardly fail to protect all these unhappy families that were leaving their fatherland to seek for better times elsewhere. He would dismiss from his mind all ungenerous suspicions about the honesty of builders and contractors. In such a way he acquired a sincere and comfortable conviction that his vessel was thoroughly safe and seaworthy; he watched her depature with a light heart, and benevolent wishes for the success of the exiles in their strange new home that was to be; and he got his insurance-money when she went down in mid-ocean and told no tales.

What shall we say of him? Surely this, that he was verily guilty of the death of those men. It is admitted that he did sincerely believe in the soundness of his ship, but the sincerity of his conviction can in nowise help him, because he had no right to believe on such evidence as was before him. He had acquired his belief not by honestly earning it in patient investigation, but by stifling his doubts.

  • W.J. Clifford, the Ethics of Belief
Comment author: Lumifer 30 September 2014 07:23:19PM 2 points [-]

An interesting quote. It essentially puts forward the "reasonable person" legal theory. But that's not what's interesting about it.

The shipowner is pronounced "verily guilty" solely on the basis of his thought processes. He had doubts, he extinguished them, and that's what makes him guilty. We don't know whether the ship was actually seaworthy -- only that the shipowner had doubts. If he were an optimistic fellow and never even had these doubts in the first place, would he still be guilty? We don't know what happened to the ship -- only that it disappeared. If the ship met a hurricane that no vessel of that era could survive, would the shipowner still be guilty? And, flipping the scenario, if solely by improbable luck the wreck of the ship did arrive unscathed to its destination, would the shipowner still be guilty?

Comment author: Anders_H 30 September 2014 09:16:59PM *  4 points [-]

I realize your questions may be rhetorical, but I'm going to attempt an answer anyways, because it illustrates a point:

The morality of the shipowner's actions do not depend on the realized outcomes: It can only depend on his prior beliefs about the probability of the outcomes, and on the utility function that he uses to evaluate them. If we insisted on making morality conditional on the future, causality is broken: It will be impossible for any ethical agent to make use of such ethics as a decision theory.

The problem here is that the Shipowner's "sincerely held beliefs" are not identical to his genuine extrapolated prior. It is not stated in the text, but I think he is able to convince himself about "the soundness of the ship" only by ignoring degrees of belief: If he was a proper Bayesian, he would have realized that having "doubts" and not updating your beliefs is not logically consistent

In any decision theory that is usable by agents making decisions in real time, the morality of his action is determined either at the time he allowed the ship to sail, or at the time he allowed his prior to get corrupted. I personally believe the latter. This quotation illustrates why I see rationality as a moral obligation, even when it feels like a memetic plague.

Comment author: Lumifer 01 October 2014 04:49:32PM 0 points [-]

The morality of the shipowner's actions do not depend on the realized outcomes: It can only depend on his prior beliefs about the probability of the outcomes, and on the utility function that he uses to evaluate them.

I am not sure -- I see your point, but completely ignoring the actual outcome seems iffy to me. There are, of course, many different ways of judging morality and, empirically, a lot of them do care about realized outcomes.

The problem here is that the Shipowner's "sincerely held beliefs" are not identical to his genuine extrapolated prior.

I don't know what a "genuine extrapolated prior" is.

I see rationality as a moral obligation

Well, behaving according to the "reasonable person" standard is a legal obligation :-)

Comment author: simplicio 01 October 2014 06:55:55PM 4 points [-]

completely ignoring the actual outcome seems iffy to me

That's because we live in a world where people's inner states are not apparent, perhaps not even to themselves. So we revert to (a) what would a reasonable person believe, (b) what actually happened. The latter is unfortunate in that it condemns many who are merely morally unlucky and acquits many who are merely morally lucky, but that's life. The actual bad outcomes serve as "blameable moments". What can I say - it's not great, but better than speculating on other people's psychological states.

In a world where mental states could be subpoenaed, Clifford would have both a correct and an actionable theory of the ethics of belief; as it is I think it correct but not entirely actionable.

I don't know what a "genuine extrapolated prior" is.

That which would be arrived at by a reasonable person (not necessarily a Bayesian calculator, but somebody not actually self-deceptive) updating on the same evidence.

A related issue is sincerity; Clifford says the shipowner is sincere in his beliefs, but I tend to think in such cases there is usually a belief/alief mismatch.

I love this passage from Clifford and I can't believe it wasn't posted here before. By the way, William James mounted a critique of Clifford's views in an address you can read here; I encourage you to do so as James presents some cases that are interesting to think about if you (like me) largely agree with Clifford.

Comment author: Lumifer 01 October 2014 07:53:35PM 2 points [-]

In a world where mental states could be subpoenaed, Clifford would have both a correct and an actionable theory

That's not self-evident to me. First, in this particular case as you yourself note, "Clifford says the shipowner is sincere in his belief". Second, in general, what are you going to do about, basically, stupid people who quite sincerely do not anticipate the consequences of their actions?

That which would be arrived at by a reasonable person ... updating on the same evidence.

That would be a posterior, not a prior.

Comment author: simplicio 01 October 2014 09:31:36PM 0 points [-]

I think Clifford was wrong to say the shipowner was sincere in his belief. In the situation he describes, the belief is insincere - indeed such situations define what I think "insincere belief" ought to mean.

what are you going to do about, basically, stupid people who quite sincerely do not anticipate the consequences of their actions?

Good question. Ought implies can, so in extreme cases I'd consider that to diminish their culpability. For less extreme cases - heh, I had never thought about it before, but I think the "reasonable man" standard is implicitly IQ-normalized. :)

That would be a posterior, not a prior.

Sure.

Comment author: Lumifer 02 October 2014 02:51:06PM *  0 points [-]

I think Clifford was wrong to say the shipowner was sincere in his belief

This is called fighting the hypothetical.

I think the "reasonable man" standard is implicitly IQ-normalized. :)

While that may be so, the Clifford approach relying on the subpoenaed mental states relies on mental states and not on any external standard (including the one called "resonable person").

Comment author: Cyan 01 October 2014 07:41:26PM 0 points [-]

That's because we live in a world where... it's not great, but better than speculating on other people's psychological states.

I wanted to put something like this idea into my own response to Lumifer, but I couldn't find the words. Thanks for expressing the idea so clearly and concisely.