And the thing is, a lot of atheists (and people in general) actively dislike precisely the things that I like.

I can definitely register the affirmative on this. Personally, I made a conscious decision to stop identifying as Jewish, back when I was attending Brandeis University, because I found the group dynamic (perhaps they would have called it solidarity, but I perceived it as bias) downright oppressive.

The feeling generalizes to most sorts of traditions. For instance, I have a hard time understanding why one would want to affiliate with a particular style or branch of martial arts given the option of a syncretic approach like Jeet Kune Do.