This actually isn't that efficient - practical learning is more than just compression.

Let me rephrase: generalization is compression. If you do not compress, you cannot generalize, which means you'll make inefficnet use of your samples.

What the brain and all effective learning systems do is more powerful and complex than just compression - it is utilitarian learning.

The term in the literature is resource-rational or bounded-rational inference.