Agreed that it is loose talk. I think the reason is that the posterior becomes the prior for the next inference, so you can think of your beliefs sloshing around and changing in response to information. After all, even the very first prior will likely have come from somewhere, and be the posterior of some other process.