I have started going through Jaynes’ book on probability. In Chapter 1 (pg 17) he lists the basic desiderata for the theory. The first desiderata is that “Degrees of plausibility are represented by the real numbers”. I understand why we want to use numbers, and why we want continuity, but why do we specifically want to use real numbers instead of rational numbers?
If you throw a dart to uniformly hit the interval [-1, 1] x [-1, 1], what is the probability that it will hit within the unit disk?
Real numbers are complete under all sorts of important properties such as integration of continuous functions over compact areas. If you don't have this closure, the math becomes impractical.
Cool. So in principle we could just as well use the rationals from the standpoint of scientific inference. But we use the reals because it makes the math easier. Thank you.
You can't get continuity without real numbers. Technically the required property is completeness, but the intuition is the same. For example, suppose you have some idea that some random number is "equally likely" in the range from 0 to 1 in some sense. You want to get a number that expresses the plausibility that its square is less than 1/2. You'll find that every rational number is either too large, or too small.
One of the intuitions of continuity is that if you have a continuous curve that goes from too small to too large, there must be a point somewhere in the middle where it is just right. If you apply this requirement to rational numbers (via the Dedekind Cut construction), you get the real numbers. Real numbers are the smallest extension of the rational numbers in which you have this sort of continuity, and so if you want a mathematical theory of plausibilities that allows rational values and continuity then you need real numbers.
Thank you.
I am a little confused. I was working with a definition of continuity mentioned here https://mathworld.wolfram.com/RationalNumber.html : "It is always possible to find another rational number between any two members of the set of rationals. Therefore, rather counterintuitively, the rational numbers are a continuous set, but at the same time countable."
I understand that Rationals aren't complete, and my question is why this is important for scientific inference. In other words, are we using the reals only because it makes the math easier, or...
I don't know if there are 'natural' events with irrational probabilities, but I think we can construct an artificial one? Roughly, let X be the event that a uniformly-random number in [0,10) is < pi; then P(X)=pi/10.* So if you were forced to give X a rational probability, what probability would you choose?
*One can't actually produce a uniformly-random real number, but here's a real-world procedure that should be equivalent to X: start generating an infinite string of digits v_i one at a time using a d10. For each digit, if it is less than the i'th digit of pi return YES, if it is greater return NO, if it is equal continue to rolling the next digit. So e.g. a roll of 2 is an immediate YES; a roll of 3 -> 1 -> 7 is a NO. This procedure takes unbounded time, but with probability 1 it terminates eventually.
This procedure takes unbounded time, but with probability 1 it terminates eventually.
Why should it terminate?
I should probably also mention that if you actually used rationals, the way you would do it (when running into the tough integrals) would be by just phrasing everything in terms of bounded approximations, which is basically just unrolling a construction of the real numbers. So you might as well just use real numbers.