HalFinney comments on Causes of disagreements - Less Wrong

24 Post author: JustinShovelain 16 July 2009 09:51PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (20)

You are viewing a single comment's thread.

Comment author: HalFinney 17 July 2009 05:15:49PM 1 point [-]

You haven't really addressed the fundamental paradox of disagreement:

Given that two people disagree, which side should you assume is right, a priori? Clearly the symmetry of the situation makes it impossible to give an a priori rule if this is all the information you have.

Now let us add one piece of information: you are one of the two people. Does this give you grounds to assume that your view is the one which is right? And if so, does it not argue equally well that the other person should assume that his own view is right? But this is a contradiction, because both opposing views can't be simultaneously more likely to be right than the other.

Hence, knowing only that you are in a disagreement, you should a priori assume your view is equally likely to be right or wrong. This should be the starting point for any analysis of disagreement, yet it is seldom adopted.

Comment author: Nick_Tarleton 18 July 2009 11:31:55PM 3 points [-]

Now let us add one piece of information: you are one of the two people. Does this give you grounds to assume that your view is the one which is right? And if so, does it not argue equally well that the other person should assume that his own view is right?

I may have non-indexical information about my own intelligence, rationality, honesty, expertise, etc., the comparison of which with my prior expectations of those features of the other person might swing me in either direction.

Comment author: HalFinney 19 July 2009 10:37:48PM 0 points [-]

Right, but realistically most of the time people start with the assumption that they are right. Also consider that probably more than 50% of people think they're smarter than average, and probably the better advice is to start off most disagreements assuming you're wrong!

Comment author: thomblake 19 July 2009 10:56:06PM 1 point [-]

probably more than 50% of people think they're smarter than average

And most of the people around here are right!

Comment author: HalFinney 20 July 2009 12:44:48AM 0 points [-]

Maybe a better heuristic is to consider whether your degree of assurance in your position is more or less than your average degree of assurance over all topics on which you might encounter disagreements. Hopefully there would be less of a bias on this question of whether you are more confident than usual. Then, if everyone adopted the policy of believing themselves if they are unusually confident, and believing the other person if they are less confident than usual, average accuracy would increase.

Comment author: thomblake 17 July 2009 05:24:19PM *  0 points [-]

But this is a contradiction, because both opposing views can't be simultaneously more likely to be right than the other.

As stated, this is not a contradiction. Look:

  • A is arguing against B
  • A should assume that p
  • B should assume that ~p

That A has good reason to assume that p and B has good reason to assume that ~p is not contradictory; if they're both rational, it just entails that they have access to different information.

And the fact that I believe that p gives me a reason to believe that p, all else being equal; after all, I can't be expected to re-evaluate all of my beliefs at all times, and must assume that my reasons for starting to believe that p were good ones to begin with. (That doesn't mean that this isn't a good time to re-evaluate my reasons to believe that p, if they're accessible to me)

Comment author: HalFinney 17 July 2009 08:10:02PM 0 points [-]

But the truth can't be dependent on which person you are, right? If we say you are Bob, or we say you are Carol, that doesn't change whether there is life on Mars. Therefore what one should assume about the truth does not change merely based on which person they are, that was my reasoning. Put more technically, truth (about factual matters where people might disagree) is not "indexical".

Comment author: thomblake 17 July 2009 08:16:24PM 0 points [-]

No, the truth isn't dependent upon which person I am, but what I should believe isn't directly dependent upon the truth (if it was, then there wouldn't be any disagreement in the first place). Rather, what I believe is dependent upon what constitutes a good reason for me to believe something, and that is indexical.

Comment author: RobinHanson 18 July 2009 01:51:59PM 2 points [-]

But how could you know they should believe P about X while you should believe Q? You can't think you are both doing what you should if you believe different things right?

Comment author: thomblake 18 July 2009 05:11:07PM 1 point [-]

If I was one of the disputants, then I would not know that the other person should believe P. Similarly, as an outside observer I would know that at least one of them is certainly incorrect (assuming your P and Q are inconsistent).

You're changing the context without warrant.

If I'm in the situation then I'll do what I should. I must then assume that the other person either has some reason to believe that Q, or that they're being irrational, or some other handy explanation. By the principle of charity I should then perhaps assume they have a good reason to believe that Q and so I should re-evaluate my reasons for believing that P.

That doesn't change that it's not contradictory for me to prefer beliefs I already hold to beliefs I don't, and to expect other people to follow the same rule of thumb. What alternative could there even be in the absence of a reason to re-evaluate your beliefs?

Comment author: HalFinney 19 July 2009 10:39:58PM 0 points [-]

One other thing I'll note as a problem with this as a heuristic ("prefer your own side in a disagreement") is that more or less by definition, it's going to be wrong at least 50% of the time (greater than 50% in the case where you're both wrong). That's not a really great heuristic.

Comment author: thomblake 19 July 2009 10:52:48PM 0 points [-]

it's going to be wrong at least 50% of the time

You maybe.

But seriously, it's not just a heuristic for disagreements. "One should prefer the beliefs one already has, all else equal" is a pretty good heuristic (a lot better than "one should have random beliefs" or "One should adopt beliefs one does not have, all else equal").

My point was simply an answer to the question, "Now let us add one piece of information: you are one of the two people. Does this give you grounds to assume that your view is the one which is right?" If I've established that one does have such a reason in general about one's beliefs, then the answer is clearly "yes".

Comment author: HalFinney 20 July 2009 12:39:45AM *  0 points [-]

I'd agree that "in general, you should believe yourself" is a simpler rule than "in general, you should believe yourself, except when you come across someone else who has a different belief". And simplicity is a plus. There are good reasons to prefer simple rules.

The question is whether this simplicity outweighs the theoretical arguments that greater accuracy can be attained by using the more complex rule. Perhaps someone who sufficiently values simplicity can reasonably argue for adopting the first rule.

ETA: Maybe I am wrong about the first rule: it should be "in general, you should believe yourself, except when you come across evidence that you are wrong". And then the question is, how strong evidence is it to meet someone who came up with a different view. But this brings us back to the symmetry argument that that is actually a lot stronger evidence than most people imagine.

Comment author: thomblake 20 July 2009 12:43:56AM 0 points [-]

I think we may have exhausted any disagreement we actually had.

As I noted early on, I agree that coming across someone else with a different belief is a good occasion for re-evaluating one's beliefs. From here, it will be hard to pin down a true substantive difference.