I've never been into science fiction, fantasy literature, anime, or D&D, but the alleged popularity of those on LW has never bothered me, nor even particularly stood out. (I mean, I've liked a few instances of the first three, but never anywhere near the point of being involved in their respective subcultures.)

You seem to be under the impression that a nerd is someone who pins a badge saying "nerd" on himself.