Yeah, I agree with Annoyance. Don't worry about it. It's like nurses - you may not have a belief at any level that nurses should be female, but you'd have to be blind not to notice that they usually are. So "nurse" is closer to "female" than "male" in your thing space.