You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Eliezer_Yudkowsky comments on [META] Karma for last 30 days? - Less Wrong Discussion

15 Post author: ArisKatsaris 30 August 2012 10:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (173)

You are viewing a single comment's thread. Show more comments above.

Comment author: DanArmak 30 August 2012 08:48:48PM *  18 points [-]

In addition to what others said, people will be discouraged from explaining downvotes. (Or maybe encouraged to explain even minor downvotes.) Once a comment is at -3 without a (good) explanation in a reply to it, people will not want to pay a penalty to explain to a potentially well meaning poster what was wrong with their comment. Instead they will be incentivized to further downvote it without explanation.

Not all comments deserving -3 karma are trolls, some are merely stupid / insensitive / wrong / unoriginal.

This change will make people think: is this comment a troll? If it is, downvote it to -3 or beyond; if not, don't downvote below -2. If that's desirable behavior, and we come to agree about it, and -3 is the right level for it, then we will have many comments at -2 that previously would have been downvoted further, because people will not want to tell others "you're trolling" unless they really think so.

(And then people would probably want comments hidden at -2, not -3: the karma level of bad, though not quite trolling, comments.)

Comment author: Eliezer_Yudkowsky 30 August 2012 10:03:19PM 1 point [-]

The site was seriously going to hell due to long troll-started threads and troll-feeding. It's not a good use-case when intelligent comments are hidden by default, either. And I now see that contrary to the feature request, it's only asking for 5 karma for immediate descendants, not anywhere in the chain, so I shall go now and ask that to be updated.

I don't want to train readers to unhide things by default just because they might miss intelligent conversation in subthreads, I don't want intelligent conversation in places it's hidden by default from readers trusting the site mechanics, I want this site to stop feeding its trolls and would prefer a community solution rather than moderators wielding banhammers, and I want this site to focus its efforts positively rather than in amazing impressive refutations of bad ideas which is a primary failure mode of any intelligent Internet site. Threads with heavily downvoted ancestors should almost always not exist, because of their opportunity costs, the behaviors they reinforce, and other long-term consequences.

If this particular effort proves insufficient, the next step will be to make it impossible for users less than three months old (or with less than 1000 karma or something) to see comments under -3 at all.

Comment author: CarlShulman 31 August 2012 06:20:18AM *  43 points [-]

The site was seriously going to hell due to long troll-started threads and troll-feeding.

I really don't see this. It looks like the main clause of decline is that spontaneous top-level postings are not enough to make up for the loss of the enormous subsidy of a good writer posting as a full-time job. 3 examples of hellish troll-feeding would be nice.

Comment author: John_Maxwell_IV 31 August 2012 09:15:13PM *  17 points [-]

It looks like the main clause of decline is that spontaneous top-level postings are not enough to make up for the loss of the enormous subsidy of a good writer posting as a full-time job.

I think LW's high standards make the activation energy for writing new posts really high. I have lots of ideas for new posts, but when it comes to actually writing them, I think to myself "is this really something LW wants to read", "is this going to make me look like an idiot", etc. I've written a few reddit self posts in the past few weeks, and it was interesting to notice how much lower my activation energy was for submitting to reddit than to LW. It's almost as though I have an ugh field around writing LW posts.

Sure, you probably want people to have this high activation energy to a certain extent; it's a good way to keep the quality high. But if we want more spontaneous top-level postings, maybe we should experiment with trying to shift the activation energy parameter downwards a bit and looking for a sweet spot.

For example, one idea is to frame the moderation system as more of a filtering system than a punishment/reward system: "It's OK to write a lame post, because if you do, it'll just get voted down and no one will read it."

Another idea is to recognize that a given user's prediction of how much LW will like their post is probably going to be terrible, and tell people that if you never get voted down, you're not submitting enough.

I think the punishment of getting voted down is way more salient for me than the reward of getting voted up, and maybe I'm not the only one who's wired this way.

Comment author: khafra 04 September 2012 07:03:42PM 1 point [-]

Would you mind sharing your reddit username? I generally like your writing and conclusions, and I'd hate to miss out on the long tail of them that may fall just below the LW margin.

Comment author: John_Maxwell_IV 04 September 2012 10:33:12PM *  1 point [-]

Hey, thanks! I prefer to keep my reddit account mostly divorced from my real identity though, and I don't think LW would find the self posts I mentioned especially interesting.

I will likely write a bunch for LW at some point, but currently I'm focusing on other stuff.

Comment author: Wei_Dai 31 August 2012 09:31:28PM 10 points [-]

It looks like the main clause of decline is that spontaneous top-level postings are not enough to make up for the loss of the enormous subsidy of a good writer posting as a full-time job.

Why don't SI people post more paper drafts and other writings here for discussion? Seems like a cheap way to both help improve the SNR here and give SI more ideas and feedback.

Comment author: CarlShulman 01 September 2012 12:55:40AM 6 points [-]

That's not rationality content. AI content is sort of grandfathered in because of the SI sponsorship and Eliezer's posting on it, but most of the LW audience is attracted by the rationality content, I think.

Comment author: Wei_Dai 01 September 2012 04:30:34AM 8 points [-]

AI content is sort of grandfathered in because of the SI sponsorship and Eliezer's posting on it

I thought AI content is considered on-topic here more because there is a strong argument, based on our current best understand of rationality, that we should make a significant effort to push the Singularity and hence the entire future of the accessible universe in a positive direction. I guess it's understandable that you might not want to overplay this and end up alienating people who are more interested in other rationality topics, but we seem still far from that point, judging from the relative lack of complaints and recent voting on AI and Singularity-related posts.

Comment author: Nornagest 11 September 2012 06:38:40PM 1 point [-]

I don't know how much paper content CFAR is planning to produce, but it would escape this objection.

Comment author: gwern 31 August 2012 11:34:43PM 0 points [-]

I've been doing just that, and it often has been done by others - for example, Luke & Anna's "Intelligence Explosion: Evidence and Import" was posted several times, I believe. They may have improved the SNR, but I can't say there seem to be very much feedback or ideas...

Comment author: Wei_Dai 01 September 2012 12:02:28AM 4 points [-]

I'm thinking of these papers which were posted here only after they were finished and published. Also this one which I posted here because Carl didn't. Also Paul Christiano posting stuff on his own blog instead of LW.

They may have improved the SNR, but I can't say there seem to be very much feedback or ideas...

That's strange. I find LW feedback useful on my posts, and assumed that would be the case for others. Can you give an example of a post that didn't gather useful feedback and ideas?

Comment author: gwern 01 September 2012 12:23:45AM 1 point [-]

Well, look at your own links.

  1. In the first link, for three papers, there's exactly one substantive comment on a paper
  2. The second link has roughly 3 or 4 comment threads which revolve around a specific point which seemed to cause changes in the paper, with the rest of the comments being relatively unrelated.
  3. The third link contains some interesting comments about the paper on a meta level, but nothing that could be useful to the author, IMO.

As for my own feedback, I keep a public list in http://www.gwern.net/Links#fn2 Going backwards through the last 3:

  1. the power post's few comments are dominated by citation format, matriarchy and why anyone cares. None of these were useful to me except maybe the format carping.
  2. the Sobel post has maybe 2 or 3 comments of value
  3. the intelligence failures link garnered 1 comment of value
Comment author: Wei_Dai 01 September 2012 12:59:00AM 3 points [-]

I guess it wasn't clear, but I was suggesting that if those papers had been posted here while they were still in draft form (as opposed to "finished and published"), they would have received more discussions since people would have more incentives to participate and potentially influence the final output.

As for your posts, I think the reason for lack of useful feedback is that they are mostly summaries of many academic papers and it's hard to give useful feedback without spending a lot of time to read those papers which nobody has an sufficient incentive to.

Comment author: Kaj_Sotala 03 September 2012 08:55:19AM 1 point [-]

I got some comments for my drafts. There were some valuable suggestions in both threads which I incorporated, but I had hoped for a little more feedback.

Comment author: Wei_Dai 03 September 2012 09:36:05PM 1 point [-]

If you post more drafts in the future, I think it would help to add more context: Who is the target audience? What are you hoping to accomplish with the papers? (If we knew that we might care more about helping you to improve them.) Do they contain any ideas that are new to LW?

Comment author: NancyLebovitz 31 August 2012 03:46:55PM 9 points [-]

Thank you. I haven't noticed an increasing problems with trolls and/or extremely low quality posts. Some of the worst seemed to be sincere posts by people with mental problems. I don't know whether there's a serious problem of LW potentially becoming a crank magnet.

Comment author: Eliezer_Yudkowsky 31 August 2012 09:02:00PM 1 point [-]

That would've been hard to find, but thankfully Gabriel did the work to find one example. Thanks Gabriel!

If you go to Configurations and Amplitude and scroll down... then you'll suddenly find this really amazingly huge thread, much much larger than anything around it. What is this wonderful huge thread, you wonder? Why, it's this:

http://lesswrong.com/lw/pd/configurations_and_amplitude/6bwo

Finding this kind of conversation dominating Recent Comments, much less Top Comments, is something I find dishedonic and I don't think it helps the site either.

Comment author: CarlShulman 01 September 2012 09:05:53AM 6 points [-]

I saw that at the time. But as Vladimir_Nesov says, they seem rare enough to not much impair my reading experience. What is your estimate of their frequency per year or per month?

Comment author: Vladimir_Nesov 31 August 2012 09:21:23PM *  6 points [-]

I thought you had something different in mind, but if it is this, I don't understand in what way is the solution of charging only for immediate replies to bad comments unsatisfactory. When I proposed this variant of the feature in the ticket, the thread you cited was exactly of the kind I was thinking about.

On the other hand, threads like this are rare, so (1) you seem to exaggerate their impact and (2) a month that you've suggested in the ticket won't be enough to see whether the direct-reply-fee solution helps, as we only get a few of these in a year.

Comment author: JoshuaZ 30 August 2012 10:38:24PM *  16 points [-]

It may be worth considering whether your intuitions and priors about how serious a problem trolling is is at odds with the impression of the rest of the community. Or, it may be that most of the people you have attracted here are somewhat more tolerant of some amount of trolling. It seems at least from the general voting in this thread that most of the community is not happy with even this change, let alone the other changes you are suggesting.

Comment author: Eliezer_Yudkowsky 30 August 2012 10:44:38PM -2 points [-]

Biased sample if those who flee the long-replies-to-downvoted-comments threads have already left. At the point where LW starts being unfun for me to read, I panic. If my standards are too high... well, there's worse things that could happen to a site, like my threshold for alarm being set too low.

Comment author: JoshuaZ 30 August 2012 10:47:35PM 14 points [-]

Biased sample if those who flee the long-replies-to-downvoted-comments threads have already left

Valid point. How can we test this?

At the point where LW starts being unfun for me to read, I panic.

Being concerned about the signal to noise ratio is reasonable, but yes this sounds like panicking. Deciding that there's a problem is not the same thing as deciding that a specific course of action is a good solution to the problem. (I shouldn't need to tell you that.)

Comment author: David_Gerard 31 August 2012 11:04:15AM 13 points [-]

The mental model being applied appears to be sculpting the community in the manner of sculpting marble with a hammer and chisel. Whereas how it'll work will be rather more like sculpting flesh with a hammer and chisel, giving rather a lot of side effects and not quite achieving the desired aims. Sculpting online communities really doesn't work very well.

Comment author: evand 31 August 2012 03:12:05AM 13 points [-]

Do you feel that this is an example of you being intolerant of other posters' tolerance of trolls? If not, why?

Personally, it seems to me that it is, but that it might well be justified anyway. I'm not a big fan of the approach taken, but I'm not yet completely against it either. I'm disappointed that it was implemented unilaterally.

Comment author: Alicorn 30 August 2012 10:31:46PM *  46 points [-]

the next step will be to make it impossible for users less than three months old (or with less than 1000 karma or something) to see comments under -3 at all.

I am vehemently opposed to this. If the problem is out-of-control threads, make the newbies unable to reply to downvoted comments - don't make them unable to look at them! Don't they need negative examples too?

Comment author: William_Quixote 31 August 2012 12:13:12AM *  18 points [-]

As someone who is a new user, I strongly agree with Alicorn.

More options don’t always make people better off, but seeing downvoted posts is an option that is actively useful for new users. One of my first comments initially got downvoted to -1, and on seeing this, I looked at other downvoted comments and was able to use what I learned to edit my post so it eventually got voted back into positive territory.

Mistake avoidance is worth learning and downvoted posts are helpful for this. I have benefited from looking at downvoted posts, and I have no reason to believe I’m atypical in this regard.

Comment author: Eliezer_Yudkowsky 01 September 2012 11:12:05PM 1 point [-]

Don't they need negative examples too?

Negative examples, if I'm a newcomer, mean that I stop reading the site because the discussion is not consistently high-quality. And newbies looking at negative examples mean that elder posters feel obliged to respond to bad comments, just in case a newbie reads them and gets fooled; it makes it mentally harder to downvote and walk away. This is a change I would strongly consider in any case.

Comment author: drethelin 30 August 2012 10:48:13PM 15 points [-]

Responding to the edit:

What are these opportunity costs, what behaviors are they reinforcing, and what are the long-term consequences you are trying to avoid?

When I respond to someone who is getting downvoted, do you think I'm likely to have been spending my time doing something better? I can't contribute usefully to a conversation about decision theory, but I can talk about plenty of other things to other people. Exactly what opportunities are being wasted, and why are they all of a sudden being wasted now it's not whatever golden age there was before the site was going to hell? Are you trying to say intelligent posters are not posting because somewhere else in some comment thread some idiot is being talked to?

Is the end goal of this simply to have any conversation stop as soon as something gets voted to -3? Really? Three random people or 1 person with 2 sockpuppets can just end a discussion? I don't understand why you can't trust people to have conversations but you can trust them to downvote wisely.

Comment author: Gabriel 31 August 2012 12:13:46AM 11 points [-]

There's a message warning about the impending karma loss that pops up before posting, right? Maybe the message alone would do the trick if it warned people that their contribution is going to be buried by default, informed them of the negative consequences of replying to crap and implored them to reconsider?

Comment author: wedrifid 31 August 2012 10:03:59AM 43 points [-]

And I now see that contrary to the feature request, it's only asking for 5 karma for immediate descendants, not anywhere in the chain, so I shall go now and ask that to be updated.

Please clarify this for me. If I am reading correctly it indicates that currently only the immediate descendent is punished but that your orders are that all descendents of that comment shall be punished too. If so that strikes me as ridiculously shortsighted. This makes us obliged to go through the entire ancestor history of a comment every time we wish to make a reply if we wish to avoid being arbitrarily punished.

If this particular effort proves insufficient, the next step will be to make it impossible for users less than three months old (or with less than 1000 karma or something) to see comments under -3 at all.

Eliezer, you should stop personally exercising your power over the forum. Your interventions are reactionary, short sighted, tend to do more harm than good and don't adequately incorporate feedback received. Consider telling someone else at SingInst what your desired outcome is and ask them to come up with a temperate, strategically sane solution that doesn't make you look silly.

Comment author: Alexandros 01 September 2012 07:07:51AM 26 points [-]

Eliezer, I would take wedrifid's suggestion incredibly seriously. You have gone from problem diagnosis (not shared by most of the community it seems), to designing a solution (not agreed to be effective by most, even if the problem stood), to marshalling the extremely limited development resources this website has at its disposal to implement it. None of these steps seem to have had any agreement by the community, and if it wasn't for the bug dug out by Akis, we may not have had a chance to even discuss it after the fact.

Pacifism isn't the only failure mode for well-kept gardens. Moderator arbitrariness is a well-known other.

Comment author: drethelin 01 September 2012 07:32:43AM 10 points [-]

I agree that well-kept gardens are better, but that means MODERATION. It doesn't mean indiscriminately spraying parts of your garden with herbicide to get rid of weeds.

Comment author: Armok_GoB 01 September 2012 07:44:50PM 4 points [-]

To clarify: HALT, MELT AND CATCH FIRE, OR THE SITE WILL DIE!

Comment author: MixedNuts 01 September 2012 07:57:54PM 3 points [-]

Do arbitrary moderators kill gardens? I've seen that happen only once, and there were many contributing factors - an exact clone people could switch to easily, moderators keeping their debater hat on, focus on punishment of specific instances rather than good generic policies, the venue being for socializing/kvetching which clashed with severity.

Comment author: satt 01 September 2012 10:03:24PM 6 points [-]

Do arbitrary moderators kill gardens?

Death isn't the only type of failure mode.

Comment author: [deleted] 01 September 2012 12:52:15AM 2 points [-]

If so that strikes me as ridiculously shortsighted. This makes us obliged to go through the entire ancestor history of a comment every time we wish to make a reply if we wish to avoid being arbitrarily punished.

Actually, you get warned as soon as you hit the Reply button.

Comment author: prase 31 August 2012 05:14:15PM 3 points [-]

This makes us obliged to go through the entire ancestor history of a comment every time we wish to make a reply if we wish to avoid being arbitrarily punished.

Since the system, as it works now, asks whether we really wish to spend karma, we wouldn't need to go through. Nevertheless I agree with the latter part of your comment.

Comment author: [deleted] 31 August 2012 07:40:39AM 17 points [-]

The site was seriously going to hell due to long troll-started threads and troll-feeding.

Can you give a few examples of that that you think are are particularly bad?

Comment author: endoself 01 September 2012 07:22:33PM 13 points [-]

I don't want to train readers to unhide things by default just because they might miss intelligent conversation in subthreads

Another way of doing this would be a five second delay to unhide hidden comments. Waiting isn't fun and it prevents hyperbolic discounting from magnifying the positive reinforcement of reading something that someone doesn't want you to read.

Comment author: Alicorn 01 September 2012 07:52:48PM 11 points [-]

This is a really good idea. It's incentivizing, noncoercive, and could possibly even have the look-and-feel of ordinary site delay rather than censorship and avoid getting people's hackles up.

Comment author: JoshuaZ 30 August 2012 10:42:47PM 13 points [-]

And I now see that contrary to the feature request, it's only asking for 5 karma for immediate descendants, not anywhere in the chain, so I shall go now and ask that to be updated.

Can you explain what this would accomplish at all? I'm not seeing anything that it accomplishes. If anything, it actively makes the problem of good threads that happen to have been started in a negatively downvoted comment worse. Moreover, it would lead to the situation where people are replying to a long-thread and then get a karma hit because it happens that way back up in the thread the initial bit got downvoted. That means that among other things, replying to threads where one is looking at single post or with a permalink becomes essentially a karma trap. This accomplishes nothing. The primary problem with trolling is that it clogs up the recent comments sections. High quality comments downthread of a bad comment don't have this problem. This seems like an even worse idea than the already implemented change by such an order of magntude that part of me is wondering if this is a deliberate use of the Dark Arts to make the current change more palatable in comparison.

Comment author: Vladimir_Nesov 30 August 2012 10:30:34PM *  9 points [-]

And I now see that contrary to the feature request, it's only asking for 5 karma for immediate descendants, not anywhere in the chain, so I shall go now and ask that to be updated.

A lot of discussion happens without much use of the context in which it started. If a good conversation starts under (perhaps 4 levels lower than) a comment that will in the future sink to -3 or lower, that stops the conversation, without any convenient way of extracting it outside that thread. I don't believe the conversation should be discouraged in such cases. (Do you think it should? I expect it would be very inconvenient and annoying without the additional subthread-extraction feature.)

On the other hand, typical clueless-feeding conversations are mostly back-and-forth between a user in a failure mode and those who reply to them directly. The clueless normally gets downvoted, but those who reply to them are not, and the measure of Karma-punishing those who directly reply to downvoted comments would address that.

Comment author: V_V 01 September 2012 01:02:43AM 3 points [-]

Let's say this gets downvoted

Comment author: V_V 01 September 2012 01:24:30AM 5 points [-]

One can post a child comment like this, or a sibiling comment to get the answers without karma penalities on those who respond.

You may well end up encouraging forum mechanics abuse with these policies.

Comment author: MugaSofer 09 November 2012 11:35:55AM 1 point [-]

No, you can't, which is why I just paid 5 karma.

Comment author: drethelin 30 August 2012 10:06:22PM 2 points [-]

[citation needed]