wedrifid comments on 2011 Survey Results - Less Wrong

94 Post author: Yvain 05 December 2011 10:49AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (513)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 06 December 2011 03:25:57PM *  4 points [-]

If you're running TDT in a population with similar agents, you want to conserve

And this is why xv15 is right and Desrtopa is wrong. Orther people do not run TDT or anything similar. Individuals who cooperate with such a population are fools.

TDT is NOT a magic excuse for cooperation. It calls for cooperation in cases when CDT does not only when highly specific criteria are met.

Comment author: cousin_it 10 December 2011 11:54:18PM *  2 points [-]

At the Paris meetup Yvain proposed that voting might be rational for TDT-ish reasons, to which I replied that if you have voted for losing candidates at past elections, that means not enough voters are correlated with you. Though now that I think of it, maybe the increased TDT-ish impact of your decision could outweigh the usual arguments against voting, because they weren't very strong to begin with.

Comment author: xv15 06 December 2011 03:59:07PM 2 points [-]

I agree. Desrtopa is taking Eliezer's barbarians post too far for a number of reasons.

1) Eliezer's decision theory is at the least controversial which means many people here may not agree with it.

2) Even if they agree with it, it doesn't mean they have attained rationality in Eliezer's sense.

3) Even if they have attained this sort of rationality, we are but a small community, and the rest of the world is still not going to cooperate with us. Our attempts to cooperate with them will be impotent.

Desrtopa: Just because it upholds an ideal of rationality that supports cooperation, does not mean we have attained that ideal. Again, the question is not what you'd like to be true, but about what's actually true. If you're still shocked by people's low confidence in global warming, it's time to consider the possibility that your model of the world -- one in which people are running around executing TDT -- is wrong.

Comment author: wedrifid 06 December 2011 04:18:22PM 1 point [-]

Desrtopa is taking Eliezer's barbarians post too far for a number of reasons.

Those are all good reasons but as far as I can tell Desrtopa would probably give the right answer if questioned about any of those. He seems to be aware of how people actually behave (not remotely TDTish) but this gets overridden by a flashing neon light saying "Rah Cooperation!".

Comment author: Desrtopa 06 December 2011 04:28:27PM 1 point [-]

There are plenty of ways in which I personally avoid cooperation for my own benefit. But in general I think that a personal policy of not informing oneself at even a basic level about tragedies of commons where the information is readily available is not beneficial, because humans have a sufficiently developed propensity for resolving tragedies of commons to give at least the most basic information marginal benefit.

Comment author: xv15 07 December 2011 12:21:53PM 0 points [-]

To me, this comment basically concedes that you're wrong but attempts to disguise it in a face-saving way. If you could have said that people should be informing themselves at the socially optimal level, as you've been implying with your TDT arguments above, you would have. Instead, you backed off and said that people ought to be informing themselves at least a little.

Just to be sure, let me rewrite your claim precisely, in the sense you must mean it given your supposed continued disagreement:

In general I think that a personal policy of not informing oneself at even a basic level about tragedies of commons where the information is readily available is not beneficial to the individual, because humans have a sufficiently developed propensity for resolving tragedies of commons to give at least the most basic information marginal benefit to the individual.

Assuming that's what you're saying, it's easy to see that even this is an overreach. The question on the table is whether people should be informing themselves about global warming. Whether the first epsilon of information one gets from "informing oneself" (as opposed to hearing the background noise) is beneficial to the individual relative to the cost of attaining it, is a question of derivatives of cost and benefit functions at zero, and it could go either way. You simply can't make a general statement about how these derivatives relate for the class of Commons Problems. But more importantly, even if you could, SO WHAT? The question is not whether people should be informing themselves a bit, the question is whether they should be informing themselves at anywhere close to the socially optimal level. And by admitting it's a tragedy of the commons, we are already ANSWERING that question.

Does that make sense? Am I misunderstanding your position? Has your position changed?

Comment author: prase 08 December 2011 07:12:20PM 5 points [-]

To me, this comment basically concedes that you're wrong but attempts to disguise it in a face-saving way.

It seems that you are trying to score points for winning the debate. If your interlocutor indeed condedes something in a face-saving way, forcing him to admit it is useless from the truth-seeking point of view.

Comment author: xv15 10 December 2011 10:28:08PM 1 point [-]

prase, I really sympathize with that comment. I will be the first to admit that forcing people to concede their incorrectness is typically not the best way of getting them to agree on the truth. See for example this comment.

BUT! On this site we sort of have TWO goals when we argue, truth-seeking and meta-truth-seeking. Yes, we are trying to get closer to the truth on particular topics. But we're also trying to make ourselves better at arguing and reasoning in general. We are trying to step back and notice what we're doing, and correct flaws when they are exposed to our scrutiny.

If you look back over this debate, you will see me at several points deliberately stepping back and trying to be extremely clear about what I think is transpiring in the debate itself. I think that's worth doing, on lesswrong.

To defend the particular sentence you quote: I know that when I was younger, it was entirely possible for me to "escape" from a debate in a face-saving way without realizing I had actually been wrong. I'm sure this still happens from time to time...and I want to know if it's happening! I hope that LWers will point it out. On LW I think we ought to prioritize killing biases over saving faces.

Comment author: prase 11 December 2011 09:31:17AM *  1 point [-]

I know that when I was younger, it was entirely possible for me to "escape" from a debate in a face-saving way without realizing I had actually been wrong. I'm sure this still happens from time to time...and I want to know if it's happening! I hope that LWers will point it out.

The key question is: would you believe it if it were your opponent in a heated debate who told you?

Comment author: xv15 11 December 2011 06:08:17PM 0 points [-]

I'd like to say yes, but I don't really know. Am I way off-base here?

Probably the most realistic answer is that I would sometimes believe it, and sometimes not. If not often enough, it's not worth it. It's too bad there aren't more people weighing in on these comments because I'd like to know how the community thinks my priorities should be set. In any case you've been around for longer so you probably know better than I.

Comment author: prase 11 December 2011 06:53:53PM *  1 point [-]

I think we are speaking about this scenario:

  • Alice says: "X is true."
  • Bob: "No, X is false, because of Z."
  • Alice: "But Z is irrelevant with respect to X', which is what I actually mean."

Now, Bob agrees with X'. What will Bob say?

  1. "Fine, we agree after all."
  2. "Yes, but remember that X is problematic and not entirely equivalent to X'."
  3. "You should openly admit that you were wrong with X."

If I were in place of Alice, (1) would cause me to abandon X and believe X' instead. For some time I would deny that they aren't equivalent or think that my saying X was only poor formulation on my part and that I have always believed X'. Later, when I cease identifying with my past self too much, I would admit (at least to myself) that I have changed my opinion. (2) would have similar effects, with more resent directed at Bob. In case of (3) I would perhaps try to continue debating to win the lost points back by pointing out weak points of Bob's opinions or debating style, and after calming down I would believe that Bob is a jerk and search hard to find reasons why Z is a bad argument. Eventually I would (hopefully) move to X' too (I don't like to believe things which are easily attacked), but it would take longer. I would certainly not admit my error on the spot.

(The above is based on memories of my reactions in several past debates, especially before I read about cognitive biases and such.)

Now, to tell how generalisable are our personal anecdotes, we should organise an experiment. Do you have any idea how to do it easily?

Comment author: TheOtherDave 10 December 2011 11:49:23PM 0 points [-]

There's a big difference between:
* "it's best if we notice and acknowledge when we're wrong, and therefore I will do my best to notice and acknowledge when I'm wrong"
* "it's best if we notice and acknowledge when we're wrong, and therefore I will upvote, praise, and otherwise reinforce such acknowledgements when I notice them"
and
* "it's best if we notice and acknowledge when we're wrong, and therefore I will downvote, criticize, and otherwise punish failure to do so."

Comment author: FeepingCreature 10 December 2011 05:30:09PM 0 points [-]

True in the immediate sense, but I disagree in the global sense that we should encourage face-saving on LW, since doing so will IMO penalize truth-seeking in general. Scoring points for winning the debate is a valid and important mechanism for reinforcing behaviors that lead to debate-winning, and should be allowed in situations where debate-winning correlates to truth-establishment in general, not just for the arguing parties.

Comment author: prase 10 December 2011 08:17:56PM 1 point [-]

This is also true in the immediate sense, but somehow implies that the debate-winning behaviours are a net positive with respect to truth seeking at least in some possible (non-negligibly frequent) circumstances. I find the claim dubious. Can you specify in what circumstances is the debate winning argumentation style superior to leaving a line of retreat?

Comment author: FeepingCreature 11 December 2011 01:48:57AM *  0 points [-]

Line of retreat is superior for convincing your debate partner, but debate-winning behavior may be superior for convincing uninvolved readers, because it encourages verbal admission of fault which makes it easier to discern the prevailing truth as a reader.

Comment author: komponisto 11 December 2011 09:29:46AM 3 points [-]

debate-winning behavior may be superior for convincing uninvolved readers, because it encourages verbal admission of fault

That isn't actually the reason. The reason debate-winning behavior is superior for convincing bystanders is that it appeals to their natural desire to side with the status-gaining triumphant party. As such, it is a species of Dark Art.

Comment author: prase 11 December 2011 09:14:54AM *  1 point [-]

it encourages verbal admission of fault

This is what I am not sure about. I know that I will be more likely to admit being wrong when I have chance do do it in a face-saving way (this includes simply saying "you are right" when I am doing it voluntarily and the opponent has debated in a civillised way up to that point) than when my interlocutor tries to force me to do that. I know it but still can't easily get rid of that bias.

There are several outcomes of a debate where one party is right and the other is wrong:

  1. The wrong side admit their wrongness.
  2. The wrong side don't want to admit their wrongness but realise that they have no good arguments and drop from the debate.
  3. The wrong side don't want to admit their wrongness and still continue debating in hope of defeating the opponent or at least achieving a honourable draw.
  4. The wrong side don't even realise their wrongness.

The exact flavour of debate-winning behaviour I have criticised makes 2 difficult or impossible, consequently increasing probabilities of 1, 3 or 4. 1 is superior to 2 from almost any point of view, but 2 is similarly superior to 3 and 4 and it is far from clear whether the probability of 1 increases more than probabilities of 3 and 4 combined when 2 ceases to be an option, or whether it increases at all.

Comment author: Desrtopa 07 December 2011 03:47:06PM *  -1 points [-]

Yes, you are misunderstanding my position. I don't think that it's optimal for most individuals to inform themselves about global warming to a "socially optimal" level where everyone takes the issue sufficiently seriously to take grassroots action to resolve it. Human decisionmaking is only isomorphic to TDT in a limited domain and you can only expect so much association between your decisions and others; if you go that far, you're putting in too much buck for not enough bang, unless you're getting utility from the information in other ways. But at the point where you don't have even basic knowledge of global warming, anticipating a negative marginal utility on informing yourself corresponds to a general policy of ignorance that will serve one poorly with respect to a large class of problems.

If there were no correlation between one person's decisions and another's, it would probably not be worth anyone's time to learn about any sort of societal problems at all, but then, we wouldn't have gotten to the point of being able to have societal problems in the first place.

Comment author: xv15 07 December 2011 11:58:11PM 2 points [-]

Unfortunately that response did not convince me that I'm misunderstanding your position.

If people are not using a TDT decision rule, then your original explicit use of TDT reasoning was irrelevant and I don't know why you would have invoked it at all unless you thought it was actually relevant. And you continue to imply at least a weaker form of that reasoning.

No one is disputing that there is correlation between people's decisions. The problem is that correlation does not imply that TDT reasoning works! A little bit of correlation does not imply that TDT works a little bit. Unless people are similar to you AND using TDT, you don't get to magically drag them along with you by choosing to cooperate.

This is a standard textbook tragedy of the commons problem, plain and simple. From where I'm standing I don't see the relevance of anything else. If you want to continue disagreeing, can you directly tell me whether you think TDT is still relevant and why?

Comment author: Desrtopa 08 December 2011 01:44:47AM 0 points [-]

People don't use a generalized form of TDT, but human decisionmaking is isomorphic to TDT in some domains. Other people don't have to consciously be using TDT to sometimes make decisions based on a judgment of how likely it is that other people will behave similarly.

Tragedies of commons are not universally unresolvable. It's to everyone's advantage for everyone to pool their resources for some projects for the public good, but it's also advantageous for each individual to opt out of contributing their resources. But under the institution of governments, we have sufficient incentives to prevent most people from opting out. Simply saying "It's a tragedy of the commons problem" doesn't mean there's no chance of resolving it and therefore no use in knowing about it.

Comment author: xv15 10 December 2011 10:48:11PM 0 points [-]

human decisionmaking is isomorphic to TDT in some domains

Maybe it would help if you gave me an example of what you have in mind here.

Comment author: Desrtopa 12 December 2011 03:30:27PM 0 points [-]

Well, take Stop Voting For Nincompoops, for example. If you were to just spontaneously decide "I'm going to vote for the candidate I really think best represents my principles in hope that that has a positive effect on the electoral process," you have no business being surprised if barely anyone thinks the same thing and the gesture amounts to nothing. But if you read an essay encouraging you to do so, posted in a place where many people apply reasoning processes similar to your own, the choice you make is a lot more likely to reflect the choice a lot of other people are making.

Comment author: [deleted] 08 December 2011 08:29:37AM 0 points [-]

Those are all good reasons but as far as I can tell Desrtopa would probably give the right answer if questioned about any of those. He seems to be aware of how people actually behave (not remotely TDTish) but this gets overridden by a flashing neon light saying "Rah Cooperation!".

He may be mistaken about how high trust the society he lives in is. This is something it is actually surprisingly easy to be wrong about, since our intuitions aren't built for a society of hundreds of millions living across an entire continent, our minds don't understand that our friends, family and co-workers are not a representative sample of the actual "tribe" we are living in.

Comment author: wedrifid 08 December 2011 08:38:51AM *  1 point [-]

He may be mistaken about how high trust the society he lives in is.

Even if that is the case he is still mistaken about game theory. While the 'high trust society' you describe would encourage cooperation to the extent that hypocrisy does not serve as a substitute the justifications Desrtopa is given are in terms of game theory and TDT. It relies on acting as if other agents are TDT agents when they are not - an entirely different issue to dealing with punishment norms by 'high trust' agents.

Comment author: [deleted] 08 December 2011 09:03:51AM *  0 points [-]

Sure.

We are in agreement on that. But this might better explain why, on second thought, I think it dosen't matter, at least not in this sense, on the issue of whether educating people about global warming matters.

I think we may have been arguing against a less than most charitable interpretation of his argument, which I think isn't that topical a discussion (even if it serves to clear up a few misconceptions). If the less than charitable argument is the interpretation he now thinks or even actually did intend, dosen't seem that relevant to me.

"rah cooperation" I think in practice translates into "I think I live in a high trust enough society that its useful to use this signal to get people to ameliorate this tragedy of the commons situation I'm concerned about."

Comment author: [deleted] 08 December 2011 08:24:16AM *  1 point [-]

Individuals who cooperate with such a population are fools.

But sometimes it works out anyway. Lots of people can be fools. And lots of people can dislike those who aren't fools.

People often think "well if everyone did X sufficiently unpleasant thing would happen, therefore I won't do it". They also implicitly believe, though they may not state "most people are like me in this regard". They will also say with their facial expressions and actions though not words "people who argue against this are mean and selfish".

In other words I just described a high trust society. I'm actually pretty sure if you live in Switzerland you could successfully cooperate with the Swiss on global warming for example. Too bad global warming isn't just a Swiss problem.

Comment author: wedrifid 08 December 2011 08:32:23AM 0 points [-]

And lots of people can dislike those who aren't fools.

Compliance with norms so as to avoid punishment is a whole different issue. And obviously if you willfully defy the will of the tribe when you know that the punishment exceeds the benefit to yourself then you are the fool and the compliant guy is not.

They will also say with their facial expressions and actions though not words "people who argue against this are mean and selfish".

Of course they will. That's why we invented lying! I'm in agreement with all you've been saying about hypocrisy in the surrounding context.

Comment author: Desrtopa 06 December 2011 03:30:35PM 0 points [-]

In which case you want an enforced policy conforming to the norm. A rational shepherd in a communal grazing field may not believe that if he doesn't let his flock overgraze, other shepherds won't either, but he'll want a policy punishing or otherwise preventing overgrazers.

Comment author: wedrifid 06 December 2011 03:47:06PM 3 points [-]

In which case you want an enforced policy conforming to the norm.

Yes, and this means that individuals with the ability to influence or enforce policy about global warming can potentially benefit somewhat from knowing about global warming. For the rest of the people (nearly everyone) knowledge about global warming is of no practical benefit.