atorm comments on Being Half-Rational About Pascal's Wager is Even Worse - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (168)
What probability are you assigning to cryonics working that makes you think it's a good idea? I was under the impression that the standard LW argument for signing up was (tiny probability of success)*(monumental heap of utility if it works)=(a good investment). If that's not your argument, what is?
Hanlon has claimed 6% before, based on a Fermi estimate that may or may not mean anything.
The difference between this and Pascal's Wager is that there's no tradeoff between small probability scenarios; there's either assured death or almost-assured-death. The argument is roughly (small probability)*(high utility) > (lost utility of cheap investment).
(But of course see gwern's remarks on the cheapness of the investment.)
You can rephrase it as a small probability of revival vs a small probability of REALLY needing that money.
The standard LW argument is that cryonics has a non-tiny probability of success. I did my own estimate, and roughly speaking, P(success) is at least P(A)P(B|A)P(C|A,B)P(D|A,B,C), where
And my honest estimates were, roughly, P(A) > .95, P(B|A) > .8, P(C|A,B) > .3, and P(D|A,B,C) > .2, giving an overall lower-bound estimate of about 5% (with a lot of metauncertainty, obviously); then I tried to estimate how much waking up in the future would really be worth to me in terms of my current values compared to the value of money now, and overall determined that it was worth it for me to sign up (but not overwhelmingly; had it been 10 times the actual cost of $20 a month for the insurance and dues, I'd have waited until I was significantly richer).
And the point of the post is that 5% is not a Pascal's Wager-esque tiny probability, but something on the level of health risks that we do in fact take seriously.
(You're welcome to take exception to my estimates, of course, but the main point is that I signed up for non-Pascalian reasons. There's actually more to consider, including the effect of MWI and anthropic reasoning on C and D, and consideration about the motivations that someone might revive cryopreserved people, but this is a good enough sketch for current purposes.)
E (should go between A and B given your chronological ordering scheme): You die in such a way that high-quality vitrification/plastination is possible. (This variable gets overlooked way too frequently in these calculations).
Ah, good call. For a young and healthy person like me, that's a significant factor, since the likely causes of untimely death would probably be unexpected and/or violent. (Anyone have an idea about how to estimate this one properly?)
Get some base rate cause-of-death statistics for people in your age group and geography. Exclude those deaths for which you are certain you are exempt (or just discount them appropriately according to your beliefs that you might die of them, but that's a lot of work and the uncertainty is already so large that this won't affect much of anything).
The hard work is finding good comprehensive stats on this. The WHO databases could be good fallback if you don't have anything better / more specific. For Canada, these proved quite useful to get a general picture.
I did some research for myself, and came to the conclusion that E is (probably) low enough until some age group that I shouldn't bother with cryonics until then. For my specifics, the rough base rates for sudden or destructive death are above 50%, while it's down to something like 15% at 45-54.
The actual math for deciding that I used ended up having a few more factors, but overall what I've got is "don't sign up for cryonics until 40+ unless some other evidence comes up (or the price goes down)".
On the other hand, while E increases with age, so does the cost of life insurance. On the third hand, so does your income and your net worth.
And on the fourth hand, anti-agathics becoming available while you're still alive would bring E back down.
I'm surprised your math came out close enough for a factor of less-than-two to make a difference.
Well, yeah, it wasn't just a factor of less than two. Discounting rates, decrease of marginal u / $, P(B) probably increasing over time, and a few other things came into account.
Not to mention the sheer increase in natural mortality rates - %-of-deaths gives you a ratio by which to cut down odds of success, but deaths-per-population is what counts in calculating expected utility of signing up for cryonics at a given time. These rates climb very sharply past 40, especially for the causes of death that cryonics can actually help with.
Overall though, I must admit (after taking another look at it) that my math is/was full of potential holes to poke at. I may be going over it more carefully at some point in the near future, or I may just end up signing up for cryonics to save myself the trouble and never have to think about it this much again (barring new evidence or other events, of course).
Expanding conjunctive probabilities without expanding disjunctive probabilities is another classic form of one-sided rationality. If I wanted to make cryonics look more probable than this, I would individually list out many different things that could go right.
Can you give a few examples?
For the purpose of establishing that it's not a Pascalian probability, it suffices to talk about a lower bound on the main line of reasoning.
Ah, I see that I said "estimate" instead of "lower bound" in the critical place. I'll edit.
In this case, I'm not seeing the disjunctive possibilities that lead one to sign up for cryo in this particular case. ABCD seem to be phrased pretty broadly, and A and B in particular are already pretty big. Do you mean as an alternate to D that, say, a new cryo provider takes over the abandoned preserved heads before they thaw? Or as an alternate to C, that even though the cost is high, they go ahead and do it anyway?
Beyond that, I only see scenarios that are nice but don't point one toward cryopreservation. Like, time travel scans of dying people meaning no one ever really died is wonderful, but it means getting cryopreserved only did good in that your family wouldn't be QUITE as sad you were gone in the time before they 'died'.
Sure. That happened already once in history (though there was, even earlier, a loss-thaw). It's why all modern cryo organizations are very strict about demanding advance payment, despite their compassionate hearts screaming at them not to let their friends die because of mere money. Sucks to be them, but they've got no choice.
Yep. I'd think FAI scenarios would tend to yield that.
Basically I always sigh sadly when somebody's discussing a future possibility and they throw up some random conjunction of conditional probabilities, many steps of which are actually pretty darned high when I look at them, with no corresponding disjunctions listed. This is the sort of thinking that would've led Fermi to cleverly assign a probability way lower than 10% to having an impact, by the time he was done expanding all the clever steps of the form "And then we can actually persuade the military to pay attention to us..." If you're going to be silly about driving down all impact probabilities to something small via this sort of conjunctive cleverness, you'd better also be silly and multiply the resulting small probability by a large payoff, so you won't actually ignore all possible important issues.
The government did sit on it for quite a while, delaying the bomb until after the defeat of Germany. Nudges from Britain were important in getting things moving.
The military "paid attention to them" long before that though.
Ah. Your reasoning seems to be sound, but I would estimate P(B|A) << 0.8. Thank you for the explanation.
My estimate of P(B|A) would be lower, too, had I not read Drexler's Engines of Creation. The theoretical limits of useful nanotech allow for devices way smaller and more efficient than the behemoths of weakly-bonded amino acid chains that make up our cells, so that cheaply repairing intracellular damage is not unreasonable at that point. (Let alone the alternative of scanning the contents and doing the real work on a computer simulation.)
At that point, it becomes a question not of whether cells are structurally intact, but of whether their inter-relationships at the necessary scale remain stably encoded after the vitrification process. (Since there are several different scales which might be "the necessary scale" for recovering a mind, this does involve some uncertainty.) Pending the outcomes of the BPF Prize and the NEMALOAD Project, I'm pretty optimistic on that front. (See here for my declarations of how I'd update given bad news on either of those projects.)
Why?
My understanding of neurobiology (BS in biology, current Plant Biology grad student) leads me to believe that the mind is not stored strictly statically in relationships between neurons, but also in the subcellular states of several proteins. These states are unlikely to be preserved in time for cryopreservation. They probably will be disrupted by the freezing process even if a living brain were to be preserved.
I need to write my "You appear to be making an argument against the technical feasability of cryonics as a comment on a blog post" blog post. I've already blogged all the pieces, but I need to write the one piece that ties it all together.
There's a lot of good reasons to believe that cyronics is highly infeasible. I agree that P(B|A) is low, and P(D|A,B,C) is also absurdly low. We don't care about starving people in Africa today; what is the likelihood that we care about dead frozen people in the future, especially if we have to spend millions of dollars resurrecting them (as is more than likely the case), especially given how difficult it would be to do so? And that's assuming we can even fix whatever caused the problem in the first place; if they die of brain cancer, how are we supposed to fix them, exactly?
Senility is another issue, as it could potentially permanently destroy portions of your brain, rendering you no longer you.
But really I find the overall probability of everything incredibly bad.
But even if we CAN do it, I suspect that it would not be worth doing because what we'd really be doing is just building a copy of you from a frozen copy most likely, in which case you, personally, are still dead; the fact that a copy of you is running around doesn't really change that, and also raises the problem that they could make any numbers of copies of people, which likely would make them dubious about doing so in the first place.
This is a standard criticism people come up with after 5 seconds of thought, and a perfect example of http://lesswrong.com/lw/h8n/litany_of_a_bright_dilettante/
Do you really think that no one in cryonics hasn't ever thought - 'wait a second! why would anyone in the future even bother putting in the work?' - and you have successfully exposed a fatal ~70-year-old blindspot in a comment written in a few seconds?
And it's not necessarily that the replies to this problem are good, but that they are what you need to reply to. There's nothing to be said for making a serve we've already returned; to advance the discussion, you need to actually hit the ball back into our court, by reading and replying to the standard replies to this point.
I have never actually seen any sort of cogent response to this issue. Ever. I see it being brushed aside constantly, along with the magical brain restoration technology necessary for this, but I've never actually seen someone go into why, exactly, anyone would bother to thaw them out and revive them, even if it WAS possible to do. They are, all for all intents and purposes, dead, from a legal, moral, and ethical standpoint. Not only that, but defrosting them has little actual practical benefit - while there is obvious value to the possible cryopreservation of organs, that is only true if there aren't better way of preserving organs for shipment and preservation. As things are today, however, that seems unlikely - we already have means of shipping organs and keeping them alive, and given the current trend towards growing organs, it seems far more likely to me that the actual method will be to grow organs and keep them alive rather than keep them in cryopreservation, and without that technology being worked on, there is pretty much no value at all to developing unfreezing technology.
That means that, realistically speaking, the only purpose of such technology would be, say, shipping humans to another planet, which while probably not really rational from an economic perspective is at least somewhat reasonably likely. But even still that is a different kettle of fish - the technology in question may not resemble present day cryogenics at all, and as such may be utterly useless for unfreezing people from present-day cyrogenic treatments. Once you can prove that people CAN be revived in that way, then there is much more incentive towards cryogenics... but that is not present day cryogenics, and there is no evidence to suggest future cryogenic treatments will be very similar to present ones.
Okay, so even all that technology aside, let's assume, at some point, we do develop this technology for whatever reason. At this point, not only do you have to bear the expense of unfreezing these people, but you also have to bear the expense of fixing whatever is wrong with them (which, I will note, actually killed them in the past), as well as fixing whatever damage was done to them prior to being cryogenically frozen (and lest we forget, 10 minutes without oxygen is very likely to cause irreparable brain damage in humans who survive - let alone humans who are beyond what we in the present day can deal with). This is likely to be very, very expensive indeed, and there is little real incentive for someone in the future to spend their money in this way instead of on something else. You are basically hoping for some rich idiot to not only be capable of doing this, but also being willing to do it and having the legal ability to do so (as, lest we forget, there are laws about playing around with human corpses, and I suspect that it is unlikely they will change positively for frozen people in the future - as if they do change, what are the odds that your frozen body won't be used in some other sort of experiment?).
I have never seen arguments which really address these issues. People wave their hands and talk about nanotechnology and brain uploading, but as someone who has actually dealt with nanotechnology I can tell you that it is not, in fact, magical, nor is it capable of many of the feats people believe it will be capable of, nor will it EVER be capable of many of the feats that people imagine it will be capable of. Nanomachines have to be provided with energy the same as anything else, among other, major issues, and I have some severe doubts about the unfreezing process in the first place due to various issues of thermodynamics and the fact that the bodies are not frozen in a setup which is likely to facilitate unfreezing them.
A lot of cryonics arguments basically boil down to "future technology is magic", and that's a pretty big problem for any sort of rational argumentation. "You can't prove that they won't be able to revive me" can be used for all sorts of terrible arguments, as the burden of proof is on the person making the argument that it IS possible, not on the person holding to the present day "we can't, and see no way to do so."
I mean, you look at things like:
http://www.alcor.org/Library/html/resuscitation.htm
The technology in here is, quite literally, magic. It doesn't exist, and it won't exist. Ever. Things on the level are very dumb; they cannot be intelligent, and they cannot act intelligently, because they are too small, too simple. The bits where they stick stuff into your cells is where things get really ridiculous, but even before then, those little nanomachines are going to have real issues doing what you are hoping for, and would have to be custom built for the task at hand. We're talking enormous expense if it is even possible to do at all, and given the extremely small cryogenic population, the odds of perfecting the technology prior to running out of dead people is not very good. Remember, if the result is brain dead or severely brain damaged, it is still a failure. But even these sorts of nanomachines are very questionable; transistors are only going to get 256 times smaller at most, which makes me question whether said nanomachines can function in the way that is hoped for at all. Of course, this is not necessarily a barrier to, say, a different sort of nanomachine (though they'd be more micromachines really, on the scale of a cell rather than on the scale of large molecules) which was controlled by some sort of external process with the little machines being extensions/remotes of it, but this is still questionable.
Extreme expense, questionable technology (which would have to be custom developed for the purpose), the question of whether cryonics is even a viable technological route for something else for cryogenic revival to piggyback on, likely custom technology for reviving people who have died of things that people no longer die of because of earlier preventative measures (why build something to fix someone with late stage cancer when no one gets late state cancer anymore?), legal problems, the necessity for experimental subjects... all of these things add up to the question of why these hypothetical future people are even going to bother. That's assuming it is even ethical to revive someone who is, say, not genetically engineered and therefore would be at the bottom of the societal heap if they were revived.
Dunning-Kruger and experience with similar religious movements suggests otherwise.
It takes someone who really thinks about most things very little time to come up with very obvious objections to most religious doctrine, and given the overall resemblance of cryonics to religion (belief in future resurrection, belief that donating to the church/cyronics institution will bring tangible rewards to yourself and others in the future, belief in eternal life) its not really invalid to suggest something like that.
Which is more likely - that people are deluding themselves over the possibility of eternal life and don't actually have any real answers to the obvious questions, but conveniently ignore them because they see the upside as being so great, or that this has totally been answered, despite the fact that you didn't even articulate an actual answer to it in your response, or even link to it?
I'm pretty sure that, historically speaking, the former is far more likely than the latter.
If someone comes up to you and starts talking about how you have an immortal soul, if you've spent any time studying medicine or neurobiology at all, or have experience with anyone who has suffered brain damage, it really doesn't take you very long to come up with a good counterargument to people having souls. And people have argued about the nature of being for -thousands- of years, and dubiousness about souls has been around for considerably longer than cryonics has been. And yet, people still believe in souls, despite the fact that a very simple, five minutes of thought counterargument exists and has never been countered.
The fact that you did not have a counter for my argument and instead linked to a page which was meant to be a "take that" directed at me is evidence against you having an actual answer to my query, which is always a bad sign. This is not to say that it doesn't have an answer, but a quick, simple answer (or link) would be no more difficult to find than the litany article.
Indeed, after looking at the Alcor site, and reading around, all I really find are arguments against it. The best argument for it that I've seen is that resurrecting 20th century people might be profitable from an entertainment/educational standpoint, but I find even that to be a weak argument - not only is resuscitating someone for the purpose of entertainment deeply morally repugnant (and likely to be so into the future), but wikipedia and various other sources from the 20th and 21st century are likely to be far more valuable to historians, while writers will benefit more from creating their own characters who are considerably more interesting than real people - and it is considerably cheaper and less morally and legally questionable to do so.
So what is the argument for it? If it is so simple to resolve, then what is the resolution?
As ciphergoth pointed out, there isn't really a good answer here. And that is troubling given that the whole thing is pointless if no one is ever going to bring you back anyway. I was reading one article on Alcor which suggested that, even for a cyronics optimist, the odds of it actually paying off were 15% if he only used his most optimistic numbers - and I think his numbers about the technology are optimistic indeed. That's bad news, especially given the guy is someone who actually thinks that doing cryonics is worthwhile.
You obviously have not actually read the Dunning-Krueger paper and understood what it showed.
Name three. Like V_V, I suspect that for all that you glibly allude to 'cults' you have no personal experience and you have not acquainted yourself with even a surface summary of the literature, much like you have not bothered to so much as read a cryonics FAQ or book before thinking you have refuted it.
And it takes even less time to notice that there are long thorough answers to the obvious objections. Your point here is true, but says far more about you than religion or cryonics; after all, many true things like heliocentrism or evolution have superficial easily thought-of objections which have been addressed in depth. Sometimes they work, sometimes they don't; the argument from evil is probably the single most obvious argument against Western religions, there are countless replies from theists of various levels of sophistication, and while I don't think any of them actually work, I also don't think someone going 'My mother died! God doesn't exist!' is contributing anything whatsoever. What, you think the theists somehow failed to notice that bad things happen? Of course they did notice, so if you want to argue against the existence of God, read up on their response.
If you had spent less time being arrogant, it might have occurred to you that I see this sort of flip reaction all the time in which people learn of cryonics and in five seconds think they've come up with the perfect objection and refuse to spend any time at all to disconfirm their objection. You are acting exactly like the person who said, "but it's not profitable to revive crypatients! QED you're all idiots and suckers", when literally the first paragraph of the Wikipedia article on ALCOR implies how they attempt to resolve this issue; here's a link to the discussion: http://lesswrong.com/lw/gh5/cryo_and_social_obligations/8d43
Notice how you are acting exactly like cheapviagra. You've come up with an obvious issue for cryonics, and rather than do any - gasp! - research; you commented on it. OK, fine. I then told you that there were replies to the issue, and that you should've known this because the issue is so obvious, and rather than learn a lesson about useful contributions, you are instead self-righteously criticizing me for not willing to drop everything and dig up every answer to every idle passing thought you have!
By the way, a benchmark I've found useful in discussing factual matters or matters with a long pre-existing literature is number of citations and hyperlinks per comment. You're still batting a zero.
I'm impressed you've failed to notice that LW is maybe a little different from other sites and we have higher standards, and what happens 'historically' isn't terribly relevant.
Apparently you missed the point. The point was: stop being arrogant. Think for a freaking second about how obvious an argument might be and at least what the reply might be, if you cannot be arsed to look up actual sources. Do us the courtesy of not just thinking your way to your bottom line of 'cryonics sucks' but maybe a step beyond that too.
Really? That's the best argument? What did you read, exactly? Where do they say 'there's no reason to revive people except for entertainment'? Or are you just picking out the weakest possible argument because that's what you want to talk about?
What? No! That's not what ciphergoth meant at all! Here is what he said:
He did not say the answers were not good. He said, that even if the answers were not good, they are still what you need to deal with. You need to work on your reading comprehension if that's what you got out of his comment. (Shades of Dunning-Kruger, since you brought it up...) Or is this another aspect of you refusing to do any research, bring up the weakest lamest arguments you can find as strawmen, and grossly misinterpret what people have said?
No, it's not bad news. It's just news. Expected value is about payoff, cost, and probability. 15% means nothing more and nothing less than 15%; without additional details, it does not mean that something is a good idea and it does not mean something is a bad idea either.
gwern's interpretation of what I wrote here is entirely correct.
"what is the likelihood that we care about dead frozen people in the future?"
I wondered that as well when I first heard about cryonics. It is true that society in general won't care about frozen people in the future. But that isn't necessary for cryonics to work. Rather its enough that cryonics organizations care about frozen people.
Why would they care? Because the people running the organization have a vested interested in making their clients live. Among other reasons, the people running the organization might one day be clients as well, so they have to care about the success of the project.
Actually I think the meat of what I want to say is here: http://blog.ciphergoth.org/blog/2010/02/15/blog-comments-and-article/
90% confidence intervals the way that I understand the cases(B and C require you to involve your interpretation because they are too interdependent under the default interpretation):
.02< P(B|A) < .2
.6<P(C|A,B)< .8
Okay, seriously, how the hell did you get this impression?
Yeah, did you ever write up a full summary of why you think signing up for cryonics is a good idea? Including, hopefully, not just the information theory stuff,, but also how likely you think it is that you will remain funded and get unfrozen even if the technical problems are all solved, etc. Can't find such an article under the cryonics tag, and I'd love to read such a thing from you.
No numbers, but I think this is the most comprehensive argument Eliezer's made on the subject (it's linked from the LW wiki page on cryonics): http://lesswrong.com/lw/wq/you_only_live_twice/
Not sure why you're getting downvoted, but I was under the impression that you were on the far end of the LW bell curves for cryonics-optimism and AI-pessimism.
I suspect he's getting downvoted because he didn't answer the question, not even with "I don't think it has a low probability of success" or some other simple response.
I think it was more like (moderate probability of success)*(monumental heap of utility if it works) = (a great investment) so this argument clearly doesn't apply.