My impression is that critiques of lesswrong mainstream positions and arguments for contrary positions are received well and achieve high karma scores when they are of very high quality. Similarly posts and comments that take lesswrong mainstream positions will still be voted down if they are of very low quality. But in between there seems to be a gulf: Moderately low quality mainstream comments will stay at 0 to -1 karma while contra-mainstream comments of (apparently) similar quality score solidly negative karma, moderately high quality mainstream comments achieve good positive karma while similar quality contra-mainstream comments stay at 0 to 2. 

Do you share my impression? And if this is the case, should we try to do something about it? 

New Comment
45 comments, sorted by Click to highlight new comments since: Today at 12:04 PM

Best thing to do about it, I think, would be to point out that putting effort into your comment will get you paperclips.

In my experience, if I do my homework and show it (e.g. links in the post), I can be not merely contrary but actually wrong, and still get awarded paperclips for effort. I presume this is a vote for "more like this", i.e. posts that put in effort.

This will also result in higher-quality comments, which is the point of awarding paperclips in the first place. So, so far so good.

In my experience, if I do my homework and show it (e.g. links in the post), I can be not merely contrary but actually wrong, and still get awarded paperclips for effort. I presume this is a vote for "more like this", i.e. posts that put in effort.

Well, that, or the effort makes you look like you're right. You could be right and a vote is translated as, "Yes, more of this," but an alternative would be, "Wow, sources, looks smart and probably right."

Or, people just don't follow the links but upvote because they're passing by and there's links with attract attention and a click of the mouse.

(Not poo-pooing your effort, just suggesting alternative interpretations.)

[-][anonymous]13y20

Best thing to do about it, I think, would be to point out that putting effort into your comment will get you paperclips.

Probably. But suppose you want to increase your paperclips per unit of effort. Then that point won't really help.

If someone wants to up their account karma per unit of effort, there are ways.

  • Rather than writing one long comment, splitting it into two gives you the chance to garner two upvotes per fan instead of one. If your comment is a mix of good and bad points, dividing it may separate the gold in your comment from the lead.

  • Putting a lot of effort into your comments can backfire, because hard to write can mean hard to read. If your long comment isn't read, it probably won't be upvoted.

  • Repetition works. If you notice that one of your comments got a lot of karma, repeating the performance can multiply your profit.

So: does effort pay off? I'm sure it does on average, but from what I've seen, the variation is very high.

Nothing substantive to say, but i do remember somebody recently suggesting that the karma "points" should be nicknamed "paperclips". It's nice to see somebody using this convention, it amuses me.

Paperclips are great. I'm finding that as I spend more time on LessWrong, I'm becoming increasingly interested in the idea of paperclips.

I tend to downvote comments that are abusive, borderline spam (nonborderline stuff I can ban), repetitive ad nauseum with other comments the same person has made recently, or -

have three or more entangled things wrong with them (where "wrong with them" doesn't include the bare fact of a non-mainstream position, but often includes the reasoning that leads to such positions).

When it's just one or two problems, or problems that exist independently and can be addressed separately, I prefer to confront the problems in a comment, and my voting thereafter is mostly dependent on how my comment is answered, if at all. (Repetition of the content of the original comment trips the "repetitive" switch, for instance, and abuse also sometimes enters the conversation at this stage.)

When it's three problems or more, all of which relate to and intertwine with each other, I feel helpless to attack any of them, because I feel like I'd have to somehow manage all of the problems simultaneously. Sometimes I click "reply" and then start to write an answer four or five times, before giving up because any grammatically correct first sentence won't do justice to the awfulness I'm reacting to. The only way to express how very bad such a comment is, is to give the entire thing a good hard swat, which means downvoting.

This is pretty much the same standard I use (save for not being able to ban spam.) I also downvote people who persist in confusions with less than three entangled problems in the face of repeated attempts at correction, but usually not when I'm attempting to provide the corrections myself because it makes me feel rude and more likely to become frustrated.

I have similar impressions. I think there may also be a difference in time: Contrarian posts and comments will sometimes get voted down very quickly, within a few minutes of being posted, then be voted up over the next few days. It could be that LW conformists are more likely to check the site obsessively, and so most of the first dozen people to see a comment are conformists.

There is a phenomenon on Wikipedia, where some editors spend their days hunched over the keyboard, not trying to make Wikipedia better, but trying to enforce their vision of Wikipedia's social norms, mostly by deleting articles with the zeal of a Spanish Inquisitor and the rules-lawyering of a D&D munchkin. See the user contributions of Realkyhick for an example of this. Note that he has several times deleted an article within minutes of it first appearing, while the author was still writing it. Perhaps there's a similar psychology at work on LW.

I think there may also be a difference in time: Contrarian posts and comments will sometimes get voted down very quickly, within a few minutes of being posted, then be voted up over the next few days. It could be that LW conformists are more likely to check the site obsessively, and so most of the first dozen people to see a comment are conformists.

I attribute this to disagreement within the immediate discourse. In general whenever a group of a few people are having an argument in a sequence of comments and (at least) one side clearly cares a new comment that refutes the previous one often receives quick downvotes. This is independent of whether the position disagrees with the community at large and depends directly on the 'other side' taking it personally.

I know that some of my highest voted series of comments actually started at below -2. It is only after a day or two that they settled at their stable 'approved of' status. In contrast to your suggestion this would seem to suggest that it takes time for the 'mainstream' tide of opinion on comment value to overwhelm the eddy current of personal dislike.

My observations are consistent with your impression and don't think we should try to do anything about it.

I also suspect that an analysis of tone -- roughly speaking, to how obnoxiously the commenter comes across -- would account for a large chunk of the variance.

I was just trying to think of what obnoxious means in this context because, well, who of us wants to come across as obnoxious? And I think it means, with some latitude, that the writer suggests that he or she is aiming at something different than what the other participants are aiming at. This could be egotism/narcissism, persuading others towards a pet belief system, or taunting others/trollishness.

The other alternative could be issues concerning rhetorical style. Either the rhetoric of the writer is uncomfortable to what the reader is accustomed to, or the emphasis of the posts makes it difficult for readers to pierce the arguments for substance.

Or other meanings I'm not aware of.

If I were to do this analysis, there are a few dimensions I would look at first to see how much variance they account for:

  • ratio of words devoted to negation, vs. words devoted to proposing an alternative idea or to asking for clarification

  • nonresponsiveness... that is, where comment C1 = X, and C2 = "-X, because Y1..Y3", and C3 = X with no significant addressing of Y1..Y3. (This is a little tricky, though because in general I expect the absolute value of karma scores to decrease the more nested they are.)

  • the combination of stridency and incoherence. (Either in isolation I wouldn't expect to account for much negative karma.)

Ahah, that certain aids in understanding your statement.

[-][anonymous]13y50

One potential function of a karma system I have not seen mentioned is that it can act as a release valve that gives a person a way to express his displeasure, fair or not. Without that release valve the person might instead write a flame, triggering a flame war. This is in addition to the fact that actual flames are themselves likely to be heavily downvoted. Some unfairly assigned negative karma may be a fair price to pay for relative freedom from flamewars and the tremendous waste of time they represent.

My impression is that there are a few issues where contrarian positions will tick people off and result in undeserved downvotes unless they're extremely well written and argued. There is also a somewhat larger set of issues where posts and comments will get upvoted heavily, and sometimes stratospherically, despite being pure applause lights. However, as someone who has written many comments of varying quality criticizing various positions that are prevalent on LW, I can say that as long as they don't touch any of the few third rails, contrarian comments overwhelmingly end up with non-negative scores even if they're less than stellar.

When it comes to posts downvoted to -1, and sometimes also -2, one confounding issue are the passive-aggressive downvotes of frustrated participants in the discussion. (Scores below -2 usually indicate a wider range of downvoters.) These typically get reversed by other readers, but sometimes nobody sees it or cares enough.

On the whole, I think the present system works as well as could be reasonably expected. The only change I'd like to see is separate tracking of upvotes and downvotes, so that controversial comments would stand apart from those that are just plain uninteresting.

The only change I'd like to see is separate tracking of upvotes and downvotes, so that controversial comments would stand apart from those that are just plain uninteresting.

I would like that too...also for top-level posts, it would be nice to know.

[+][anonymous]13y-50

I share this impression. But it might be due to some sort of self-congratulatory/Lake Woebegone bias about my own comments since almost all my contra-mainstream comments have been voted up. This is true for a large variety of different criticisms. Thus I've been critical of cryonics, of AI fooming, and Bayesianism. I've been deeply critical of the narrative here that portrays phlogiston as a bad scientific theory, and every single comment of that form has been voted up. But there's a related issue: I do try to talk in a way that will get LW people to listen. Thus for example, when discussing cryonics, I will go out of my way to explicitly discuss it in terms of expected utility because that gives a useful common vocab. If one tried to discuss cryonics from some form of deontological ethics even if the system had strongly anti-deathist attitudes, I expect that this would lead to confusion and downvoting here.

Edit: Another thing that seems to help get contra-mainstream comments voted up is to acknowledge weaknesses in one's idea. If one includes counter-arguments to what one is saying, even if one only includes a few of them, one comes across as more reasonable. Coming across as Tevye the milkman but leaning against LW consensus works a lot better than coming across as just strongly against the consensus.

Thus I've been critical of cryonics, of AI fooming,

I'm not sure how mainstream these positions actually are. While these positions are certainly held by several high status members of the community, I'm pretty sure a majority of posters don't believe in AI fooming and wouldn't be surprised if a significant fraction are critical of cryonics.

We really need to clarify, for everyone, whether a down-vote means 'I disagree' or 'I think you shouldn't have posted this at all'.

For what it's worth, when I arrived here it became pretty clear to me pretty quickly that a downvote is intended to mean "I want less of this sort of thing."

That some people want less disagreement is perhaps unfortunate, and perhaps not, but in neither case is it necessarily a sign of confusion, and further clarification may not help. This may be a case, rather, of values in opposition.

I think I heard an excellent answer, somewhere, that suggested that upvotes/downvotes merely represent "I want more people to see this" or "I want less people to see this". This is implied in the system that will reorganize the posts such posts with higher scores will be put in a more conspicuous on the page.

As excellent as that answer is, however, I do wonder if it misses something. As much as we might prefer votes to have a consistent interpretation, I think this bends to the idea that the meaning of a vote on a post depends on the nature of the post. Sometimes it is a method of voting on whether the argument is sound, sometimes it is voting on whether you like the post, sometimes it voting on whether you like the poster, and sometimes it is voting on the rhetorical style of the post. Someone could even make a post saying "vote me down if you like this post", whereby votes are unparsably ambiguous.

Do you share my impression? And if this is the case, should we try to do something about it?

Not a priority. Obviously comments that people disagree with are going to be voted worse than those they agree with. And while we can't say that people agree with the mainstream by definition it is not far from it.

I haven't done a solid survey, but I don't share your impression. I frequently see contra-mainstream comments get 6 or 7 karma; I also upvote them myself when I think they're well done.

Moderately low quality mainstream comments will stay at 0 to -1 karma while contra-mainstream comments of (apparently) similar quality score solidly negative karma,

Another influence that may be confounding your observations here is that comments with scores below -2 get automatically hidden.When is a commenter most likely to look at buried comments? Quite possibly, when there's an argument over the validity of a mainstream position going on. This would lead to bad contra-mainstream comments getting looked at and downvoted further even after they're buried.

You say:

I frequently see contra-mainstream comments get 6 or 7 karma;

The OP says:

arguments for contrary positions are received well and achieve high karma scores when they are of very high quality

...and yet you frame this as not sharing the OP's impression, which confuses me, because it sure does sound like your impressions are compatible.

I think I misread this:

moderately high quality mainstream comments achieve good positive karma while similar quality contra-mainstream comments stay at 0 to 2.

as

high quality mainstream comments achieve good positive karma while similar quality contra-mainstream comments stay at 0 to 2.

And, of course, the borderline between high quality and moderately high quality is very subjective. So, our impressions are mostly compatible but they differ enough that I don't see a problem.

[-][anonymous]13y20

Do you share my impression?

I agree, but I think it's more a 'feature' rather than a 'bug'. As I see it, the advantage of the present system is that we're not condemned to keep on debating basic philosophical questions until everyone agrees, which in any case would never happen.

Chalmers said this when he dropped by (at least I think it was him):

One way that philosophy makes progress is when people work in relative isolation, figuring out the consequences of assumptions rather than arguing about them. The isolation usually leads to mistakes and reinventions, but it also leads to new ideas. Premature engagement can minimize all three.

I started out disagreeing strongly with the last part of your description, and I still lean that way - I think "moderately high quality" disagreement gets at least as much positive karma as moderately good agreement.

It does occur to me that we could be using a double standard when it comes to 'scholarship'. By this, I mean criticism that misunderstands the "mainstream" position (or seems to) likely gets downvotes even when we don't fully grasp the critic's position. At a glance, the current dispute seems like weak evidence for people talking past each other (and plain old annoyance at someone asking Bayesians what they could possibly mean by "support".)

But even knowing this, I don't feel that actively curious about an old but out-of-fashion philosophy which, according to its proponent here, denies any degree of validity to the reasoning that we observe people using to stay alive. Some philosophies are just wrong. In a quick search I can't find curi making an effort to explain how critical rationalism escapes the problems of Bayes, which seems like the best way to show that studying Popper has value for me. ("If you don't understand it, that's a criticism -- it should have been easier to understand.") Tell me that (say) your approach rules out a species consistently using the Gambler's Fallacy to set probabilities or reject theories, and we'll talk.

For curi: having read the link, do you think evolution would 'criticize' that species out of existence? What makes you think so? What makes your reasons less circular than assigning a rough probability?

I don't think that this tends to be the case. My impression is that if someone doesn't understand the mainstream positions here, they'll usually be offered corrections unless their position appears to be too confused for explanation to be likely to help. Curi didn't start being downvoted until he started demonstrating poor debate conduct, including exercising double standards himself with regards to scholarship and polite behavior.