Anyway, is there some halfway sane equivalent to talking about a uniform prior here?

Yes, (depending what you mean by half-way sane). You can have a prior that all your sense inputs are uniformly distributed. This prior is stable since no matter what sense inputs you experience they're just as likely as any other. For reasons that should be obvious, I certainly don't recommend adopting this prior.