Casual use of profanity and obscenity is associated with lower social classes, e.g. "swearing like a sailor."

Someone who doesn't want to be considered part of a lower-class social group by anyone who overheard your exclamation, and isn't willing or able to visibly dissociate themselves from you, would be well served by making sure you don't repeat it.