[Based on Alexandros's excellent dataset.]
I haven't done any statistical analysis, but looking at the charts I'm not sure it's necessary. The discussion section of LessWrong has been steadily declining in participation. My fairly messy spreadsheet is available if you want to check the data or do additional analysis.
Enough talk, you're here for the pretty pictures.
The number of posts has been steadily declining since 2011, though the trend over the last year is less clear. Note that I have excluded all posts with 0 or negative Karma from the dataset.
The total Karma given out each month has similarly been in decline.
Is it possible that there have been fewer posts, but of a higher quality?
No, at least under initial analysis the average Karma seems fairly steady. My prior here is that we're just seeing less visitors overall, which leads to fewer votes being distributed among fewer posts for the same average value. I would have expected the average karma to drop more than it did--to me that means that participation has dropped more steeply than mere visitation. Looking at the point values of the top posts would be helpful here, but I haven't done that analysis yet.
These are very disturbing to me, as someone who has found LessWrong both useful and enjoyable over the past few years. It raises several questions:
- What should the purpose of this site be? Is it supposed to be building a movement or filtering down the best knowledge?
- How can we encourage more participation?
- What are the costs of various means of encouraging participation--more arguing, more mindkilling, more repetition, more off-topic threads, etc?
Here are a few strategies that come to mind:
Idea A: Accept that LessWrong has fulfilled its purpose and should be left to fade away, or allowed to serve as a meetup coordinator and repository of the highest quality articles. My suspicion is that without strong new content and an online community, the strength of the individual meetup communities may wane as fewer new people join them. This is less of an issue for established communities like Berkeley and New York, but more marginal ones may disappear.
Idea B: Allow and encourage submission of rationalism, artificial intelligence, transhumanism etc related articles from elsewhere, possibly as a separate category. This is how a site like Hacker News stays high engagement, even though many of the discussions are endless loops of the same discussion. It can be annoying for the old-timers, but new generations may need to discover things for themselves. Sometimes "put it all in one big FAQ" isn't the most efficient method of teaching.
Idea C: Allow and encourage posts on "political" topics in Discussion (but probably NOT Main). The dangers here might be mitigated by a ban on discussion of current politicians, governments, and issues. "Historians need to have had a decade to mull it over before you're allowed to introduce it as evidence" could be a good heuristic. Another option would be a ban on specific topics that cause the worst mindkilling. Obviously this is overall a dangerous road.
Idea D: Get rid of Open Threads and create a new norm that a discussion post as short as a couple sentences is acceptable. Open threads get stagnant within a day or two, and are harder to navigate than the discussion page. Moving discussion from the Open Threads to the Discussion section would increase participation if users could be convinced thatit was okay to post questions and partly-formed ideas there.
The challenge with any of these ideas is that they will require strong moderation.
At any rate, this data is enough to convince me that some sort of change is going to be needed in order to put the community on a growth trajectory. That is not necessarily the goal, but at its core LessWrong seems like it has the potential to be a powerful tool for the spreading of rational thought. We just need to figure out how to get it started into its next evolution.
Similarly to what some others have written, my attitude toward LessWrong is that it would best thrive with this model:
1. Embrace the Eternal September.
If LessWrong is successful at encouraging epistemic and especially instrumental rationality, people who have benefited from the material here will find less value in staying and greater opportunities elsewhere. LessWrong doesn't need to be a place to stay any more than does a schoolhouse. Its purpose could be to teach Internet users rationality skills they don't learn in ordinary life or public school, and to help them transition into whatever comes next after they have done so.
Since culture is always changing, to best aid new waves of people, the Sequences will need to be scrapped and crafted anew on occasion.
2. Aim lower.
Eliezer had motives in writing the Sequences in the way he did, and he also had a very narrow background. It has often been noticed that the demographics here are absurdly skewed toward high IQ people. My presumption is that our demographics is a consequence of how things like the Sequences are written. For example, Eliezer's supposedly "excruciatingly gentle" introduction to Bayesianism is in fact inaccessible for most people; at least it was difficult for me as a high-but-not-very-high IQ person with (not-recent) years of statistics training, and I pointed friends toward it who simply gave up, unable to make progress with it. A new Sequences could do well to have multiple entry points for people of different backgrounds (i.e. abandon the programmer jargon) and ordinary IQs.
3. Extend higher.
If we want to keep longtime participants from moving on, then we have to give them additional value here. I can't give advice here; I feel I've already learned more theoretical rationality here than I can effectively ingrain into habit.
Upvoting #2, way after the fact.