Vladimir_Nesov comments on Rationality, Cryonics and Pascal's Wager - Less Wrong

12 [deleted] 08 April 2009 08:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (54)

You are viewing a single comment's thread. Show more comments above.

Comment author: AnnaSalamon 09 April 2009 01:37:38AM *  11 points [-]

I think some of those are a bit optimistic and some a bit pessimistic; perhaps the errors cancel out. My guess is that there are more ways for the chain to fail unexpectedly than to succeed unexpectedly, so most likely my estimate is too optimistic. Anyway, it ends up at 3/2048.

Here’s the thing: let’s say that there’re some “objective probabilities” out there, and that your estimate is indeed “most likely too optimistic” compared to those objective probabilities, but that there’s some significant (e.g., 10%) chance that it’s too pessimistic with compared to those same probabilities. If your estimate is “over optimistic”, its overoptimistic by at most 3/2048. If your estimate is “over pessimistic”, it could easily be over pessimistic by more than ten times that much (i.e., by more than 30/2048; Robin Hanson’s estimates the odds as “>5%”, i.e. more than 100/2048). And if you’re trying to do decision theory on whether or not to sign up for cryonics, you’re basically trying to take an average over the different values these “objective probabilities” could have, weighted by how likely they are to have those values -- which means that the scenarios in which your estimate is “too pessimistic” actually have a lot of impact, even if they’re only 10% likely.

Or in other words: one’s analysis has to be unusually careful if it is to justify a resulting probability as low as 3/2048. Absent a terribly careful analysis, if one is trying to estimate some quantity that kinda sounds plausible or about which experts disagree (e.g., not “chances we’ll have a major earthquake during such-and-such a particular milisecond), one should probably just remember the overconfidence results and be wary of assigning a probability that’s very near one or zero.

Comment author: Vladimir_Nesov 10 April 2009 10:02:37AM *  0 points [-]

Hmm... I have an idea regarding this, and also regarding Roko's suggestion to disregard low probabilities.

  • If you are generally unable to estimate probabilities of events lower than, say, 1/1000, it means that you must calibrate the estimates for these events way down, below 1/1000.

There are very many things that you'll only be able to estimate as "probability below 1/1000", some of them mutually exclusive. Normalization requires keeping the sum of their probabilities below unity, so the estimate must actually be tuned down. As a result, you can't insist that there are parts of the distribution resulting from uncertain estimate that are sufficiently high to matter, and generally should treat things falling in this class as way less probable than the class suggests.