The word "evidence", for example, has no French equivalents to my knowledge

It has no terribly good Italian equivalent either, but this doesn't make it hard to talk in a Bayesian way: you just say stuff like “it's likely that X, given that Y”. (In particular, ISTM that --among the kind of people usually I hang with at least-- “folk probability” resembles Bayesianism much more than frequentism, and most people who use frequentist statistics only give lip service to it without being actually convinced it makes all that sense.)