The association fallacy is indeed what Yvain invokes: "An association fallacy is an inductive informal fallacy of the type hasty generalization or red herring which asserts that qualities of one thing are inherently qualities of another, merely by an irrelevant association."

Key to demonstrating the association fallacy is identifying the intended association because only then can you go on to argue that it's irrelevant. Ignore this step and you are likely to fall into another fallacy: the straw-man argument.