it's not found in any Buddhist primary source

What is a Buddhist primary source? None of the discourses were written down until some centuries after the Buddha's time. The discourses that we have do themselves exist and whatever their provenance before the earliest extant documents, they are part of the canon of Buddhism. The canon has accreted layers over the centuries, but the Kalama Sutta is part of the earliest layer, the Tripitaka.

I've heard it might be

You've heard? That it might be? :-)

It is readily available online in English translation. It attributes these words directly to the Buddha:

Come Kalamas. Do not go upon what has been acquired by repeated hearing; nor upon tradition; nor upon rumor; nor upon what is in a scripture; nor upon surmise; nor upon an axiom; nor upon specious reasoning; nor upon a bias toward a notion that has been pondered over; nor upon another's seeming ability; nor upon the consideration, "The monk is our teacher." Kalamas, when you yourselves know: "These things are bad; these things are blamable; these things are censured by the wise; undertaken and observed, these things lead to harm and ill," abandon them.

and in another translation:

Now, Kalamas, don't go by reports, by legends, by traditions, by scripture, by logical conjecture, by inference, by analogies, by agreement through pondering views, by probability, or by the thought, 'This contemplative is our teacher.' When you know for yourselves that, 'These qualities are skillful; these qualities are blameless; these qualities are praised by the wise; these qualities, when adopted & carried out, lead to welfare & to happiness' — then you should enter & remain in them.

If I had the time, I'd be tempted to annotate the passage with LessWrong links.

ETA: For the second translation, the corresponding paragraph is actually the one preceding the one I quoted. The sutta in fact contains three paragraphs listing these ten faulty sources of knowledge. Buddhist scriptures are full of repetitions and lists, probably to assist memorisation.

ETA2: Rationalist version: Do not rest on weak Bayesian evidence, but go forth and collect strong.