Currently, the comment for which I've received the most positive karma by a factor of four is a joke about institutionalized ass-rape. A secondhand joke, effectively a quote with no source cited. Furthermore, the comment had, at best, tangential relevance to the subject of discussion. If anyone were to provide a detailed explanation of why they voted as they did, I predict that I would be appreciative.
Based on this evidence, which priors need to be adjusted? Discuss.
As a counterpoint, my highest rated comments are huge walls of text. This could be because (a) I don't make a lot of jokes or (b) I make crappy jokes or (c) people like my walls of text more than the typical wall of text or (d) something else.
I keep an eye on my karma and have noticed these things that I believe are related to your post:
Talking about the karma system has fallen out of favor. I think people are getting tired of it.
Asking why something was downvoted usually brings more upvotes unless you really, really deserved the downvotes. This latter case will probably be swarmed with downvotes.
Some (many?) people vote with an end score in mind. These meta-voters have more affect on threshold comments that fluctuate between -2 and 2.
Long conversations will generally pull between -1 and +2 per post. Most of my karma comes from lengthy discussions in the comments. Even if the top level post was only rated +2 I will net almost 100 karma points from the post and comments. (Note: I haven't actually added this up. It may be closer to 75 karma.)
Quick responses pointing out third alternatives or simple problems get upvoted and usually roam between +2 and +14. If you want to get your karma higher, this is the easiest way. Comment immediately after a post is submitted and point out the most obvious flaw respectfully and concisely. Don't try to make a point, just note an error. If you get in before the rest of us, you will probably get +4 or higher.
Long responses pointing out serious problems get upvoted but have a lower chance of pulling large amounts of karma than quick responses. However, after the first wave of quick responses, only the longer comments are true candidates for higher karma. I suspect that a long response to a quick comment has a good chance to do well, but haven't really watched those comments yet.
Jokes are upvoted when they are either extremely funny or solidly funny and on topic. Randomness is upvoted if it is an inside joke, otherwise stays around +0. Sarcasm is appreciated but has the problem of being mistaken for nonsarcasm.
Extending the point or conversation of a top-level post gets upvoted. Most of mine get between +2 and +4. Examples would be almost every comment I have made while reading the sequences.
Aggressiveness is generally poorly received on technical topics. Aggressiveness is easier to get away with when dealing with fuzzy topics. I attribute this mostly to margin of error. Technical topics are harder to be bulletproof. I am still having a hard time predicting which non-technical top level posts are voted up. I suspect this is because I don't know what is already been discussed or that the issue is a technical topic that I have misidentified.
Self-depreciation is a huge karma pull. Both my highest rated post and comment were essentially me slamming myself over and over. Each were voted higher than +20.
Bullet point lists of extensions, ideas, questions, and so on seem to do about as well or better than long paragraphs of text. The walls of text may be harder to skim for goodies or the bullet point list better organized?
Non-aggressive requests for clarification or information are not generally downvoted. Mine seem to roam between 0 and +2 karma. If the question and response delve into a lengthy but friendly conversation, I seem to get between 0 and +2 karma for each of my comments. If a solid agreement or conclusion is reached, the capping comment gets about double whatever the individual comments were getting.
Posting nearby "famous" people amps up the karma action. Replying to EY, Alicorn, Vladimir_Nesov, pjeby, et al will increase the amount of people that read your comments. The reasons for this are varied. The four I used here are just names that popped into my head. Also, some people seem to vote up conversations they are in while others do not. A few downvote anyone disagreeing with them. The people that matter generally fit these criteria: (a) top contributer (b) easily recognizable name (c) frequent poster/commenter (d) abnormal amount of recent activity (e) holds atypical beliefs for the community (f) a troll.
Better grammar, spelling, and language increases the likelihood that your comment will move upward faster.
Comments quickly upvoted higher than typical seem to either (a) go through the roof or (b) get meta-voted back to between +1 and +3.
Telling people to vote in a particular way tends to produce easy to predict results but not in a manner that is easy to describe.
And oh wow did that get long. Do note that this is all being typed from the top of my head using myself and the comments I read as an example. Naturally, the above does not dictate how people vote.
EDIT: I guess for fun, I predict that this comment gets ROT13orgjrra cbfvgvir gjb naq cyhf fvk xneznROT13.
EDIT 2: I would normally downvote a post such as this but elsewhere in the comments you seemed to have received the message and was wondering about deleting it. So I just left it as it is. Also relevant: I generally do not upvote jokes unless they are truly amazing.
There also appears to be a non-linear effect where posts that reach a certain threshold of votes get even more votes - like there's some kind of 80/20 power law at work. I can think of a number of possible explanations for that phenomenon but it would be interesting to see if the data backs up my impression first. I predict that the Gini coefficient for comment karma is > 0.3. Does anyone know a better way to obtain the data than a web scraper?
ETA: I'm referring to the Gini coefficient for individual comments' karma rather than for individual commenters'.
ETA2: How to handle negative karma? I'd suggest ignoring negative scoring posts but other suggestions welcome.
This analysis looks brilliant, but the impression is sort of spoiled by the fact that the prediction of karma gain failed. It is even close to self-referential paradoxes: comment reading "This comment will get X karma" should be upvoted because of its precise prediction when it actually has X karma, but upvoting makes the precision worse and may attract later downvotes.
Yeah, I was way off. I didn't think people would be that interested in karma theory. I think the big oops was the first bullet point.
Posting nearby "famous" people amps up the karma action
This in itself strikes me as a sufficient incentive to aim at getting into the "Top contributors" list. My "return on time investement" for participating in LW is what I learn (often tangentially) from getting into interesting conversations. The lower my chance of being ignored, the higher my expected utility from any contribution to LW.
There is a slight difference between being a top contributor and being famous as I am mentioning it here.
My current karma experiment is deliberately not posting comments I think are worth less than 2 karma unless I have a compelling reason to do so (such as asking for help or information). My goal is to increase the quality of my comments to the point that someone could think, "What has MrHen posted recently?" and the answer is more impressive than a series of one-liners and nitpicky comments.
Ideally, this will increase the weight of my words to the point that when I speak, people will listen. It is a pure, straightforward status grab, but one that doesn't involve gobbling up karma. The pinnacle of the status tree at LessWrong is to have someone think, "I, the reader, am wrong" instead of, "they, the writer, are wrong."
I am compiling a mental list for LW status games, rewards, and penalties that is similar to the karma list above. I am not much for status games but the gaming here seems to be harder to avoid than in real life. ("Avoid" is the wrong term but conveys the right intent. Status games are hard to "avoid.")
My biggest regret with the above karma list is that I have no good way to verify or catalogue my comments and their karma. LW just doesn't have any tools to make such a thing easy. I worry that the status list will be even further removed from reality -- possibly to the point of being unable to predict anything at all.
In any case, I like to think that I am getting better in regards to comment quality and topical knowledge. My karma rating keeps going up, so that's a good sign.
EDIT: Replaced "I think will be rated lower than 2 karma" with "I think are worth less than 2 karma."
Why do you want more status?
Do you have ideas that you think are good but won't be heard unless you're more respected?
Not so much ideas as things that I think would be helpful but will be buried in obscurity at the level I am.
That being said, this is helped more by learning the basics through reading the sequences than playing status games. My thoughts on status should be taken with the clarification that I am primarily seeking to learn and am thinking about status because I find it interesting.
If I can take my comments and change my behavior so as to be looking forward and increase my status without hampering my ability to learn... why shouldn't I? When I look at the various status levels here at LessWrong I notice the highest level I can see, which is the one I mentioned in my previous comment.
These comments are meant to be taken as observations for people who are curious or interested. I am not nearly as concerned with status as these comments may imply. I just know status is there and wonder about it in the same way I wonder about most things.
My biggest regret with the above karma list is that I have no good way to verify or catalogue my comments and their karma. LW just doesn't have any tools to make such a thing easy.
Have you tried Wei Dai's script?
This reminds me of that my highest rated so far answer at Stack Overflow was a big bullet pointed list.
I think the format itself (a list, where each item is at least a whole sentence) has a connotation of thoroughness and authority; and it reduces the TL;DR effect by presenting the content in small-but-not-trivial separable pieces.
Also, I see a “wall of text” as not having bullet points: being a series of long paragraphs without much structure visible without reading the text itself. The term is being misapplied to this comment in my opinion.
The vote I just added was because:
(I downvoted this post.)
I haven't upvoted the joke, mainly because I think that jokes generate more karma than I think they are worthy, and thus I never upvote jokes since the moment I made that observation. But hadn't I the deliberate policy of never upvoting jokes, I would simply upvote it because it was funny.
Remember, upvoting here, from a single user perspective, is a boolean scale. A good comment earns my single upvote, a bad comment earns single downvote, while most comment pass along without my voting because a) I don't read them for different reasons or b) I am not sure whether they are good or bad.
If you make a thoughtful comment, many readers aren't interested to read it and skip it, because it is probably too long, or because it is incomprehensible, or because they aren't interested. From those who read, they would need to think about it for a while before they realise that the reply was really good, and maybe forget to upvote afterwards. On the other hand, a joke generates quite a few instinctive upvotes at the beginning, which makes it even more visible (I tend to read upvoted comments first and more carefully), the visibility then generates more karma.
Nobody is responsible for the others' choices and thus for the fact that the comment stands now at +16. For any single user, the joke is at +1 as well as other better posts, which (s)he is aware of. We want to hear good jokes and thus want to reward them somehow, and the system doesn't allow to differentiate between them and the information-bearing intelligent comments. I suppose that if it was possible to upvote on some more continuous scale, the seeming discrepancy between the individual preferences and the collective voting results would disappear.
Note, for comparison purposes, that this related comment stands at +10 after 22 hours.
Edit: The parent stands at +4 after 24 hours.
Do you mean that I have uselessly written basically the same thing in 15 times more words? I have read your comment, but I think mine isn't completely isomorphic, although it is related.
It's more that RobinZ post is itself an example of the effect that very post describes (as does your post, in a way), and your post is an example of the effect at the other end of the spectrum. RobinZ seems to be making the prediction that your post will not gain as much karma.
your post will not gain as much karma
It certainly will not, but do we know whether this will be because of the length, or because RobinZ's post is simply better, or because it was posted sooner?
It is not a well-controlled experiment - but ciphergoth's top-level comment, which is later than prase's, has already gotten more votes than prase's. This would suggest that the delay was not an overwhelmingly strong effect.
(Actually, MrHen's comment likewise, and MrHen's is not short.)
There are other effects as well, status of the commenter included. People are more likely to read longer comments if the author is known to make good comments. I guess that this effect is weaker for shorter comments where the evaluation of actual content is easier. So, low status karma maximisers should write a lot of brief comments, and as they reach high status, they should swap to longer "walls of text".
Correct on every point. Indeed, prase's comment appears to imply the same prediction.
Edit: I posted my comment primarily in order that, when timestamp "18 March 2010 09:55:55AM*" arrives, a reader can examine the two posts and observe the difference in karma corresponding to the same length of voting time. I would do so myself, but that timestamp is pretty early in my time zone.
I was editing that in while you were replying or at least before I saw the reply, ironically I hadn't read prase's post all that closely so it didn't come to mind immediately.
FAWS is correct, but (1) thanks for asking - I should have made that clear, and (2) props for calculating the ratio of the wordcounts. ;)
(Edit: I admit that I had actually suspected you were intentionally performing the experiment when I first saw your comment - I know I was intentionally writing a short, immediately-comprehendible comment myself, to invoke the effect; that made it plausible to me that you were intentionally writing a long, substantive comment for the same reason.)
No, I wasn't performing an experiment, at least not intentionally. In fact, I didn't count your comment as a cheap karma generator (I have even upvoted it, IIRC) - it was brief, but relevant reply to the OP, and not visibly funny.
It wasn't meant to be a cheap karma generator - it was meant to be short and easy to confirm as good. The jokes everyone have been talking about are likewise.
You raise a valid point, but,as is, it is not worthy of a top level post. I predict it would have had positive karma as comment in the open thread or meta thread.
"Worthy?" If that is defined by positive or negative karma, then yes, it is not worthy. However, when you want an answer to a question and are willing to lose karma for it, the current incentives are for making a top level post rather than an open thread comment, as long as you can deal with the people making meta comments...
I would say that karma measures the community's aggregate perception of worthiness, but does not define worthiness. My personal perception of worthiness reflects on the importance of the topic and the quality and novelty of the contribution to that topic.
Once it is published, I believe that deleting really only removes the links to it from the various post feeds. But do take it as a learning experience.
Well, at least I've got enough of a buffer to try again.
But do take it as a learning experience.
I always try to. So long as we're on the subject, any tips on top-level post subject selection and formatting?
Edit: I spoke too soon.
My preferences for top level posts, which seem to be a higher standard than the community average, is that they should present some novel insight into a relevant topic, and reflect some research into previous work on the topic; or that they offer a deep review of a relevant work external to Less Wrong.
Do you mean to imply I am underestimating the community average standard? I was basing my assessment on karma scores on posts I consider low quality, not so much on what people decide to post.
Good point - I still think it is relevant to note that those with low standards will be more willing to post, but given that your evidence is independent, the "bear in mind" is unwarranted.
My default place to write something is the Open Thread or a comment on a relevant post. It's only if I realize that an idea needs to be a top-level post (because it's too important and not found elsewhere in a post, or because it's a lengthy development of a key idea) that I make it into one.
As you can see from my two articles, this may be too strict a standard, but I think it's in the right direction relative to the median.
While I don't think this type of post should in general be encouraged, it has generated an interesting discussion on karma; -7 (current score) seems unduly harsh to me.
It occurs to me that a reasonable strategy for some fraction of LessWrongers may be to downvote immediately and remove that downvote later, under some circumstances. Immediate feedback teaches the lesson, and subsequent change removes the undue harshness.
Following this logic, I have removed my downvote.
This reminds me of reddit. I quite enjoy reading the highly rated jokes (or whole joke subthreads) there.
I, for one, try to downvote jokes which are funny but not profound, occasionally, when I think of it.
In the tradition of institutionalized ass-rape, we all just raped you in the ass by voting you down to -7 ;-0
It certainly will not, but do we know whether this will be because of the length, or because RobinZ's post is simply better, or because it was posted sooner?
It is not a well-controlled experiment - but ciphergoth's top-level comment, which is later than prase's, has already gotten more votes than prase's. This would suggest that the delay was not an overwhelmingly strong effect.
(Actually, MrHen's comment likewise, and MrHen's is not short.)