My thought is that the 'compression mode' model of language - that it doesn't actually communicate very much, but relies on the recipient having a similar enough understanding of the world to the sender to decode it - is relevant here.

i.e., language is something that works on the listener's priors, like all intersubjective things.