A long blog post explains why the author, a feminist, is not comfortable with the rationalist community despite thinking it is "super cool and interesting". It's directed specifically at Yvain, but it's probably general enough to be of some interest here.
http://apophemi.wordpress.com/2014/01/04/why-im-not-on-the-rationalist-masterlist/
I'm not sure if I can summarize this fairly but the main thrust seems to be that we are overly willing to entertain offensive/taboo/hurtful ideas and this drives off many types of people. Here's a quote:
In other words, prizing discourse without limitations (I tried to find a convenient analogy for said limitations and failed. Fenders? Safety belts?) will result in an environment in which people are more comfortable speaking the more social privilege they hold.
The author perceives a link between LW type open discourse and danger to minority groups. I'm not sure whether that's true or not. Take race. Many LWers are willing to entertain ideas about the existence and possible importance of average group differences in psychological traits. So, maybe LWers are racists. But they're racists who continually obsess over optimizing their philanthropic contributions to African charities. So, maybe not racists in a dangerous way?
An overly rosy view, perhaps, and I don't want to deny the reality of the blogger's experience. Clearly, the person is intelligent and attracted to some aspects of LW discourse while turned off by other aspects.
Yes, they need to know our buttons and press them. Such as:
you are an unfriendly place for women;
you say that politics is the mindkiller, but secretly all of you are libertarians (or all of you are conservatives);
you are actually a cult;
...and for the best impact: all of the above, in a long article, with citations out of context from random parts of the website; quoting some offensive and heavily downvoted comments and presenting them as a typical LW content; claiming to be an expert on artificial intelligence or quantum physics and claiming that everything LW says on these topics is a pseudoscience. Did I forget something important? Oh yes, the basilisk! And end with a huge generalization that this all proves that LW is a horrible group of people, and that you will tell everyone you know to avoid LW: both your personal friends, and also any scientist or an organizer of an atheist or skeptic meetup.
(I am not saying this is what the linked article did. Just that this is what I would include into a troll manual, and bet money that LW couldn't resist discussing such article. But a subset of this is enough to succeed.)
Eh, it's been done.
(As it happens, that article's been linked before in Discussion without triggering a big argument. But the Discussion post was deleted, and the post only mentioned that "Cult of Bayes' Theorem" article in a parenthetical aside, so it's not a very good natural experiment.)