So you endorse calling them on it, ceteris paribus?
What you do about any particular instance will obviously depend on the situation. Some things are worth speaking up about. Some things are worth making non-verbal indications that their joke is bombing. Some just deserve to be ignored. You don't want to be this guy.
As Multiheaded added, "Personal is Political" stuff like gender relations, etc also may belong here.