The reactionary anti-feminist currents within the anarchist mileu often disavow feminism both personally and as an implication of anarchism, since anarchism is for "freedom for everyone" and feminism is for "freedom for women." Typically, this goes along with making the (false) claim that "patriarchy oppresses everyone," or that "Identity politics is a waste of time."

You're looking at this in a very set-theoretic way as an outsider to that particular community, so it's not surprising that you don't get this, but you should be able to find any of the above arguments in any discussion of anarchism and feminism on the Internet.