My general tactic has been when people use the term to say more or less the version like what you quoted is "problematic" and then explain more or less the ok meaning. Most of the time if you do so, people will be more careful at least for the remainder of the conversation.

On the other hand, at least once when I did so, I was informed that what I was attempting to do was "mansplaining" and "coming from a position of privilege to control what it means to have privilege" and I more or less threw up my hands. I don't know if the individual in question was hopelessly mindkilled or not, but it exceeded my patience level.