Yes, there is an asymptotic limit where eventually you just approach the analytic estimator, and need more empirical/sensory data. There are almost always asymptotic limits, usually the "platonic" or "true" full-information probability.

But as I said, it was an analogy for beginners, not a complete description of how I expect a real AI system to work.