Elo comments on Lesswrong Potential Changes - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (88)
This feels wrong to me. I mean, I would like to have a website with a lot of high-quality materials. But given a choice between higher quality and more content, I would prefer higher quality. I am afraid that measuring these KPIs will push us in the opposite direction.
Reading spends time. Optimizing for more content to read means optimizing for spending more time here, and maybe even optimizing for attracting the kind of people who prefer to spend a lot of time debating online. Time spent reading is a cost, not a value. The value is what we get from reading the text. The real thing we should optimize for is "benefits from reading the text, minus time spent reading the text".
I think the subreddits should only be created after enough articles for given category were posted (and upvoted). Obviously that requires having one "everything else" subreddit. And the subreddits should reflect the "structure of the thingspace" of the articles.
Otherwise we risk having subreddits that remain empty. Or subreddits with too abstract names, or such that authors are confused where exactly which article belongs. (There will always be some difficult cases, but if the subreddit structure matches the typically written articles, the confusion is minimized.) For example, I wouldn't know whether talking about algorithms playing Prisonners' Dilemma belongs to "AI" or "math", or whether debates of procrastination among rationalists and how to overcome it are "instrumental" or "meta". By having articles first and subreddits later we automatically receive intensional definition of "things like this".
Perhaps we could look at some existing highly upvoted articles (except for the original Sequences) and try to classify those. If they can fit into the proposed categories, okay. But maybe we should have a guideline that a new subreddit cannot be created unless at least five already existing articles can be moved there.
Upvoting and downvoting should be limited to users already having some karma; not sure about exact numbers, but I would start with e.g. 100 for upvoting, and 200 or 300 for downvoting. This would prevent the most simple ways to game the system, which in its current form is insanely fragile -- a single dedicated person could destroy the whole website literally in an afternoon even without scripting. This is especially dangerous considering how much time it takes to fix even the smallest problems here.
EDIT:
It would be nice to have scripts for creating things like Open Thread automatically.
Definitely add PJ Eby to the list. I am strongly convinced that ignoring him was one of the largest mistakes of the LW community. I mean, procrastination is maybe the most frequently mentioned problem on this website, and coincidentally we have an expert on this who also happens to speak our language and share our views in general, but instead of thinking about how to cooperate with him to create maximum value, CFAR rather spent years creating their own curriculum from the scratch which only a few selected people have seen. (I guess a wheel not invented in the Bay Area is not worth trying, despite all the far-mode talk about the virtue of scholarship.)
I have a lot of KPI's because I realise some will not be effective. as we know; what gets measured gets optimised for; which is why I think having so many different measures will help make it hard to select for the wrong goals. By at least watching all of them; I expect we are likely to be able to make progress.
Agree. But how? if you have a better metric for measuring that I would gladly try to implement it; until then - I came up with the best possible solutions I could.
I am thinking tags might be an easer implemented and stronger solution. maybe two layers of tags; one for "content tags" and one for "sorting tags". The content tags will be anything (as per the current system). The sorting tags will be a set number of possible tags and clearly visible everywhere for sorting posts by, and posting into.
Some sorting tags will also be able to be auto-assigned i.e. +10karma score. which can then be automatically aggregated to an RSS feed.
I like these ideas.
Yes and no; particularly no on meetups. I don't want dead meetups to appear on the meetup schedule, I was thinking an opt in email, "the last time you planned this meetup was 2 weeks ago; would you like to set one for two weeks now; reply "yes" to this email to confirm a meetup with the same location and this date and time."
A weekly thread can be automated; a monthly thread will find less use being automated. But certainly an option.
PJ eby added.
Edit: On second thought; if you want to just remove those particular KPI's or "discount their validity a lot" I can also do that.
I'm thinking, but not sure, whether watching average karma would be a good idea.
Or maybe some curve that would transform article karma, something like articles with positive karma would get "karma - 10" points, and articles with zero or negative karma would get constant "-10" points, and measuring a sum of that. (The rationale is that we subtract a few points as a cost of time spent reading; but we don't penalize the negative-karma articles too much, because skipping an article with -100 karma is just as easy as skipping an article with -5 karma.)
when was the last time you skipped an article, comment or post because it was negative? (not that you are a typical user) (and maybe this is worthy of a poll in the OT)
This seems reasonable in general, aside from that minor quibble.
As one anecdata point, I do generally skip articles with much negative karma. I read via RSS, so I just hit 'mark read' on them. LW users are not big downvoters, most of the time, so if something has more than a few downvotes, I have found that I probably don't want to read it.
And of course, comments with a score of -3 are hidden by default, so many people probably don't read them.