A long blog post explains why the author, a feminist, is not comfortable with the rationalist community despite thinking it is "super cool and interesting". It's directed specifically at Yvain, but it's probably general enough to be of some interest here.
http://apophemi.wordpress.com/2014/01/04/why-im-not-on-the-rationalist-masterlist/
I'm not sure if I can summarize this fairly but the main thrust seems to be that we are overly willing to entertain offensive/taboo/hurtful ideas and this drives off many types of people. Here's a quote:
In other words, prizing discourse without limitations (I tried to find a convenient analogy for said limitations and failed. Fenders? Safety belts?) will result in an environment in which people are more comfortable speaking the more social privilege they hold.
The author perceives a link between LW type open discourse and danger to minority groups. I'm not sure whether that's true or not. Take race. Many LWers are willing to entertain ideas about the existence and possible importance of average group differences in psychological traits. So, maybe LWers are racists. But they're racists who continually obsess over optimizing their philanthropic contributions to African charities. So, maybe not racists in a dangerous way?
An overly rosy view, perhaps, and I don't want to deny the reality of the blogger's experience. Clearly, the person is intelligent and attracted to some aspects of LW discourse while turned off by other aspects.
I agree that this is by far the most interesting part of the piece. IIRC this site is pretty much all white men. Part of it is almost certainly that white men are into this sort of thing but I can't help but imagine that if I was not a white man, especially if I was still in the process of becoming a rationalist, I would be turned off and made to feel unwelcome by the open dialogue of taboo issues on this website. This has the obvious effect of artificially shifting the site's demographics, and more worryingly, artificially shifting the site's demographics to include a large number of people who are the type of person to be unconcerned with political correctness and offending people. I think while that trait in and of itself is good, it is probably correlated with certain warped views of the world. Browse 4chan for a while if you want examples.
I think that between the extremes of the SJW Tumblr view of "When a POC talks to you, shut the fuck up and listen, you are privileged and you know nothing" and the view of "What does it matter if most of us aren't affected by the problems we talk about, we can just imagine and extrapolate, we're rationalist, right?" is where the truth probably lies.
Like you said, I have no idea what to do about this. There are already a lot of communities where standard societal taboos of political correctness are enforced, and I think it's worthwhile to have at least one where these taboos don't exist, so maybe nothing.
I'm a white man who's done handsomely in the privilege lottery and I find quite a lot of LW utterly offputting and repellent (as I've noted at length previously). I'm still here of course, but in fairness I couldn't call someone unreasonable for looking at its worst and never wanting to go near the place.