It could be that they were smarter already, or that similar effects are apparent for people with shared non quantitative backgrounds as well.

Yes, there are multiple possible causes. I'm just expressing my intuition (based on a huge amount of evidence that I can't easily share) and I'm saying that there's reason to make a Bayesian update in the direction of what I'm saying. Naturally, the size of the update depends on how compelling my perspective seems.