I think Sam Harris gets it mostly right.

I think that “atheist” is a term that we do not need, in the same way that we don’t need a word for someone who rejects astrology. We simply do not call people “non-astrologers.” All we need are words like “reason” and “evidence” and “common sense” and “bullshit” to put astrologers in their place, and so it could be with religion.