I am very unsympathetic by nature to people who claim the right to block any conversation that they personally find offensive.

Despite some of the rhetoric flying around at the time, I don't think anyone involved made that sort of claim. It was rather more like "I find this sort of thing offensive" and "Maybe we should listen to him, since lots of people probably would be turned away by that sort of thing, and the offensive bits aren't really necessary."

See Eliezer's contribution, Of Exclusionary Speech and Gender Politics. Nutshell: We should avoid doing things that make people feel excluded, and that includes being sensitive and not being all feministy. So basically we want both of the potentially-interested groups you've identified to stay.

ETA: Surely I've overstated my case. Eliezer did suggest that he didn't think it would be a problem to ban PUA if it bothered people; the main idea is that PUA isn't that important of a topic in the grand scheme of things, so whatever.