gwern comments on Rationality Quotes August 2013 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (733)
It's ridiculous if taken literally as a universal prior or bound, because it's very easy to contrive situations in which refusing to give probabilities below 1/10^12 lets you be dutch-booked or otherwise screw up - for example,
log2(10^12)is 40, so if I flip a fair coin 50 times, say, and ask you to bet on every possible sequence.... (Or simply consider how many operations your CPU does every minute, and consider being asked "what are the odds your CPU will screw up an operation this minute?" You would be in the strange situation of believing that your computer is doomed even as it continues to run fine.)But it's much more reasonable if you consider it as applying only to high-level theories or conclusions of long arguments which have not been highly mechanized; I discuss this in http://www.gwern.net/The%20Existential%20Risk%20of%20Mathematical%20Error and see particularly the link to "Probing the Improbable".
Yes, that's how I read it. Obviously it doesn't literally mean you can't be very sure about anything; the message is that science is wrong very often and you shouldn't bet too much on the latest theory. So even if it's a complete misquote, it's a nice thought.