Comment Permalink

CarlShulman12y210

My median timeline estimate for loosely human-level AI (i.e. it is technically feasible to build AI that can do most anything a human can do, although AI performance would be superhuman in many areas, as it already is), conditional on no catastrophes stopping forward progress would be near the end of the century. This is not a very stable or solid estimate, and I would update a lot on seeing the views of folks who had studied the issues and accumulated strong track records in prediction exercises like DAGGRE focused on technological forecasting and other relevant areas, among many other things.

Eliezer Yudkowsky12y210

Median doom time toward the end of the century? That seems enormously optimistic. If I believed this I'd breathe a huge sigh of relief, upgrade my cryonics coverage, spend almost all current time and funding trying to launch CFAR, and write a whole lot more about the importance of avoiding biocatastrophes and moderating global warming and so on. I might still work on FAI due to comparative advantage, but I'd be writing mostly with an eye to my successors. But it just doesn't seem like ninety more years out is a reasonable median estimate. I'd expect bloody uploads before 2100.

Carl, ???

See in context

68 Update on Kim Suozzi (cancer patient in want of cryonics)

by ahartell

22nd Jan 2013

1 min read

68

Kim Suozzi was a neuroscience student with brain cancer who wanted to be cryonically preserved but lacked the funds. She appealed to reddit and a foundation was set up, called the Society for Venturism. Enough money was raised, and when she died on the January 17th, she was preserved by Alcor.

I wasn't sure if I should post about this, but I was glad to see that enough money was raised and it was discussed on LessWrong here, here, and here.

Source

Edit: It looks like Alcor actually worked with her to lower the costs, and waived some of the fees.

Edit 2: The Society for Venturism has been around for a while, and wasn't set up just for her.

CryonicsDeathCommunity

Frontpage

68

Mentioned in

22[LINK] The Cryopreservation of Kim Suozzi

New Comment

63 comments, sorted by

top scoring

Click to highlight new comments since: Today at 1:43 PM

[-]Error12y180

Wow.

I don't have the confidence in the advisability of cryonics that most here seem to; but I still want to applaud this. Well done, Internet, and I dearly hope she wakes one day.

[-]advancedatheist12y160

In 1992 I attended a dinner held by Alcor's people to commemorate the 25th anniversary of the cryosuspension of James Bedford, who has managed to stay frozen after all these years and currently resides at Alcor.

Mike Darwin gave one of his characteristically passionate and learned speeches at this event, where he invoked Joseph Campbell's ideas popular at the time about the Hero's Journey. As I recall it, Mike said that James Bedford, an ordinary man, went on a fantastic journey across time to an unknown future, in effect becoming a new kind of mythic hero. Some day, Mike said, Bedford the myth might contribute to reconstituting Bedford the man.

Bedford hasn't exactly become a household name, but then his suspension happened before most of today's Americans were born. Kim Suozzi's struggle and cryosuspension, by contrast, has happened in our awareness and in a different media environment. She may have the potential to become a kind of mythic heroine for the millennial generation. And I would certainly like to see Suozzi the myth become Suozzi the healthy, whole young woman again.

We just need some poets to tell this myth in compelling ways. Stephenie Meyer has demonstrated that a market exists for stories about ordinary mortal women of Kim's generation who become "reverse Arwens" by rejecting aging and other human limitations.

Steven B. Harris, MD, also wrote about the repurposing of mythological tropes for cryonics purposes years ago in his essay, "Cryonics And The Resurrection Of The Mythic Hero," which you can read by scrolling down on this page:

http://www.alcor.org/cryonics/cryonics8809.txt

[-]advancedatheist12y130

I'd like to thank LessWrongers who donated for Kim's suspension. I hope you didn't donate your money in vain.

May science speed you, Miss Suozzi.

[-]Viliam_Bur12y80

These days, publicity can make you literally immortal!

[-]gwern12y30

Emphasis on 'can', I suppose, given the absence of revivals...

[-]wedrifid12y80

Enough money was raised, and when she died on the January 17th, she was preserved by Alcor.

Alcor? That's curious. Given the critical lack of funds I would have expected Cryonics Institute to be used. It seems like enough money and then some was raised!

[-]saturn12y150

Given what I've heard about CI's quality control, I don't blame her for trying to raise enough money for Alcor.

[-]ModusPonies12y00

What have you heard about CI's quality control, and do you happen to have the sources conveniently available? (I'm making the decision between CI and Alcor.)

[-]saturn12y50

I don't have any special insight on this subject, only what I've picked up from reading LW and occasionally talking about it on IRC. Many sources are linked from the comments in this thread (the comments are much more informative than the original post). To sum up, it seems that both CI and Alcor are lamentably bad, but CI is considerably worse.

[-]Morendil12y20

Read the comments here, they're interesting.

[-][anonymous]12y60

I am so incredibly glad that she made it.

[-]advancedatheist12y60

I've thought of a way of managing the religious objection to Kim's possible revival versus Abrahamic afterlife beliefs. Eternity doesn't mean endless time like we experience it. Many theologians argue that in eternity, our assumptions and experiences about time don't apply. Kim's soul, whatever that means, could very well exist in eternity in whatever place god assigns it (preferably a tolerable one if god considers her an "anonymous christian," despite her agnosticism), yet this soul could also inhabit the realm of time in Kim's revived and restored body (and she'll literally need a body because she got a neurosuspension) in Future World.

In other words, each outcome doesn't necessarily have to exclude the other. I work with a woman who converted to Orthodox Christianity and has a side business selling icons, and apparently in that tradition a "mystery" doesn't have the meaning of "puzzle" which the human mind can potentially solve and understand, as in our use of the phrase "murder mysteries." Orthodox Christians believe that not only does the human mind not understand god's mysteries; the human mind simply cannot understand them. Instead the Christian has to accept the mystery as a revelation of god's transcendent sovereignty over creation. Kim's revival might find some elbow room in this understanding of "mystery" for certain kinds of religionists who might otherwise consider her demon-possessed or a zombie.

Reference: http://en.wikipedia.org/wiki/Anonymous_Christian

[-]CarlShulman12y90

Mark, I'm curious. I gather you are a supporter of cryonics who is very critical of most proposed routes to reviving or reconstructing cryopreserved people. How would you hope to be revived if you are cryopreserved? And what probabilities would you input into Jeff Kaufman's probability spreadsheet (adding your answers there would be very interesting, if you'd like)?

[-]sdr12y60

Farewell, and see you on the other side!

[-]loup-vaillant12y40

when she died

She's clinically dead for sure, but probably not information theoretic dead. I'd rather use the latter definition.

Anyway, she did successfully raised her odds, so that looks like good news.

[-][anonymous]12y120

At the end of the day, one only corresponds with the clinically living.

[-]loup-vaillant12y20

Here is how I feel: the odds are not good, I can do close to nothing about it, and I have to wait a lifetime to boot. It sucks, but there's still that small glimmer of hope.

A coffin doesn't feel that way. When I see one, I just want revenge.

(Edit: /retribution/revenge)

[-]jefftk12y10

By "probably not" do you mean that her odds of being information-theoretically dead are less than 50%? Where would you put them?

[-]loup-vaillant12y40

I do mean less than 50%. Something below 10%, even. I'm just quite confident that someone who is cryopreserved, especially recently, still contain enough information to be reconstructed. On the other hand, I don't know enough about the physical structure of the human mind to be completely sure. I'd say most of my probability for her being actually information-theoretically dead lies in my ignorance of the subject.

Anyway, that's about 90% of her being still alive. My probability that she will be revived eventually is much lower, of course. I have to account for existential and catastrophic risks, the economic collapse of Alcor, the failure to further our technology… Heck, some religious fanatics may bomb the place for all I know (that one is below 1%).

[-]James_Miller12y40

I interviewed Kim for a potential article for humanity+ magazine about her quest to get charitable funds to pay for cryonics. The article was never published because very shortly after my interview Alcor decided to fully fund Kim. Here is part of the article:

Kim Suozzi’s Cold and Lonely Journey To Outrun Brain Cancer

Like any sensible girl diagnosed with a fatal disease, 23-year-old Kim Suozzi is making arrangements to be cryogenically preserved. Kim has brain cancer, and although she's participating in a clinical trial for an experimental treatment, she told me that without cryonics her chance of survival would be basically zero.

As hard as it should be to believe, there are actually some people in Kim's position who forgo cryonics to accept certain death even though these people don't want to die. There are cancer patients who would spend every penny they have plus a bunch of taxpayer dollars, and then (if it were necessary) crawl across broken glass for a traditional treatment that would give them only a few percentage points chance of survival, but who have no interest in cryonics. Although I don't think all of these people should be forced into cryonics, at the very least they should be compelled to take a sanity test to determine if they're capable of making rational medical decisions. After all, the norm in Western society is to treat a preference for suicide as a sign of mental illness.

Of course, in reality it's people who sign up for cryonics , such as this author, who are considered mentally suspect. Fewer than 3,000 people have ever registered for cryonics despite the fact that over a hundred million have surely heard of it. We consider death, especially when it strikes someone who should be only in the first third of her life, a horrible, heartbreaking tragedy. Yet cryonics, which offers a means of escaping or at least postponing death, is something almost no one opts for, making Kim Suozzi a socially brave pioneer rather than an ordinary cancer patient.

If you think that, as futurist Ray Kurzweil writes, the Singularity is near (Kurzweil estimates 2045) then it won't take too long before cryonics could be used to revive you. Kurzweil has signed up for cryonics, and Kim told me that the plausibility of Kurzweil's analysis is a big part of why she is interested in cryonics.

[-]CarlShulman12y190

If you think that, as futurist Ray Kurzweil writes, the Singularity is near (Kurzweil estimates 2045)

James, you've seen this study of past AI predictions, this independent grading of Kurzweil's predictions, and the stagnation of computer serial speeds and neuroimaging resolution, right? Hans Moravec has already made several predictions of AI progress based on hardware progress that have been falsified too.

[-]Kawoomba12y30

Do you have a Singularity ETA, and if so, may I ask what it is?

[-]CarlShulman12y210

[-]Eliezer Yudkowsky12y210

Carl, ???

[-]CarlShulman12y180

AI has had 60 years or more, depending on when you start counting, with (the price-performance cognate of) Moore's law running through that time: the progress we've seen reflects both hardware and software innovation. Hardware progress probably slows dramatically this century, although neuroscience knowledge should get better.

Looking at a lot of software improvement curves for specific domains (games, speech, vision, navigation) big innovations don't seem to be coming much faster than they used to, and trend projection suggests decades to reach human performance on many tasks which seem far from AGI-complete. Technologies like solar panels or electric vehicles can take many decades to become useful enough to compete with rivals.

Intermediate AI progress has fallen short of Kurzweilian predictions, although it's still decent. Among AI people AGI before the middle of the century is a view seen mainly in groups selected for AGI enthusiasm, like the folk at the AGI conference, but less so among the broader AI community. And there's Robin's progress metric (although it still hasn't been done for other fields, especially the ones making the most progress).

Are we halfway there, assuming we can manage to keep up this much progress (when progress in many other technological fields is slowing)?

Intelligence enhancement for researchers, uploads, and other boosts could help a lot, but IA will probably be a long time coming (biology is slow: FDA for drugs, maturation for genetic engineering) and uploads are very demanding of hardware technology and require much better brain models (correlated with AI difficulty).

I didn't say 87 years, but closer to 87 than 32 (or 16, for Kurzweil's prediction of a Turing-Test passing AI).

[-]Kaj_Sotala12y150

The main thing that makes me suspect we might have AGI before 2100 are neuroprostheses: in addition to bionic eyes for humans, we've got working implants that replicate parts of hippocampal and cerebellar function for rats. At least one computational neuroscientist that I know of has told me that we could replicate the human cerebellum as well pretty soon, but the hard problem lies in finding suitable connections that could be used to interface the brain with computers well enough. He was also willing to go on record on neocortex prostheses not being that far away.

If we did have neural prostheses - the installation of which might end up becoming a routine medical procedure - they could no doubt be set to also record any surrounding brain activity, thus helping reverse engineer the parts we don't have figured out yet. Privacy issues might limit the extent to which that was done with humans, but less so for animals. X years to neuroprosthesis-driven cat uploads and then Y years to figuring out their neural algorithms and then creating better versions of those to get more-or-less neuromorphic AGIs.

The main crucial variables for estimating X would be the ability to manufacture sufficiently small chips to replace brain function with, and the ability to reliably interface them with the brain without risk of rejection or infection. I don't know how the latter is currently projected to develop.

[-]Dreaded_Anomaly12y20

The main thing that makes me suspect we might have AGI before 2100 are neuroprostheses: in addition to bionic eyes for humans, we've got working implants that replicate parts of hippocampal and cerebellar function for rats.

The hippocampal implant has been extended to monkeys.

[-]wedrifid12y20

The hippocampal implant has been extended to monkeys.

I want one!

[-]Kaj_Sotala12y00

Thanks, I'd missed that.

[-]Eliezer Yudkowsky12y120

This is a rather important point. How do we get more info on it? You're the first halfway-sane person I've ever heard put the median at 2100.

From my perspective if you told me that in actual fact AGI had been developed in 2120 (a bit of a ways after your median) despite the lack of any great catastrophes, I would update in the direction of believing all of the following:

Rogue biotech hadn't actually been a danger. You didn't make any strong predictions about this because it was outside your conditional; I don't know much about it either. Basically I'm just noting it down. Also, no total global worse-than-Greece collapse, no nuclear-proliferated war brought on by global warming, etc.
Moore's Law had come to a nearly complete permanent halt or slowdown no more than 10-20 years after 2013.
AI academia was Great Stagnating (this is relatively easy to believe)
Machine learning techniques that actually had non-stagnat-y people pushing on them for stock-market trading also plateaued, or weren't published, or never AGI-generalized.
All the Foresight people were really really optimistic about nanotech, nobody cracked protein folding, or that field Great Stagnated somehow... the nanotech-related news I see, especially about protein folding, doesn't seem to square with this, but perhaps the press releases are exaggerated.
Large updates in the direction of global economic slowdown, patent wars kill innovation everywhere, corruption of universities even worse than we think, even fewer smart people try to go into real tech innovation, etcetera.
Biotech stays regulation-locked forever - not too hard to believe.
Anders Sandberg is wrong about basically everything to do with uploading.

It seems like I'd have to execute a lot of updates. How do we resolve this?

[-]CarlShulman12y160

Moore's Law had come to a nearly complete permanent halt or slowdown no more than 10-20 years after 2013

Well atom-size features are scheduled to come along on that time-scale, believed to mark the end of scaling feature size downwards. That has been an essential part of Moore's law all along the way. Without it, one has to instead do things like use more efficient materials at the same size, new architectural designs, new cooling, etc. That's a big change in the underlying mechanisms of electronics improvement, and a pretty reasonable place for the trend to go awry, although it also wouldn't be surprising if it kept going for some time longer.

AI academia was Great Stagnating (this is relatively easy to believe)

The so-called "Great Stagnation" isn't actually a stagnation, it's mainly just compounding growth at a slower rate. How much of the remaining distance to AGI do you think was covered 2002-2012? 1992-2002?

All the Foresight people were really really optimistic about nanotech

Haven't they been so far?

In any case, nanotechnology can't shrink feature sizes below atomic scale, and that's already coming up via conventional technology. Also, if the world is one where computation is energy-limited, denser computers that use more energy in a smaller space aren't obviously that helpful.

perhaps the press releases are exaggerated

Could you give some examples of what you had in mind?

Large updates in the direction of global economic slowdown, patent wars kill innovation everywhere, corruption of universities even worse than we think, even fewer smart people try to go into real tech innovation, etc.

Well, there is demographic decline: rich country populations are shrinking. China is shrinking even faster, although bringing in its youth into the innovation sectors may help a lot.

Biotech stays regulation-locked forever - not too hard to believe.

Say biotech genetic engineering methods are developed in the next 10-20 years, heavily implemented 10 years later, and the kids hit their productive prime 20 years after that. Then they go faster, but how much faster? That's a fast biotech trajectory to enhanced intelligence, but the fruit mostly fall in the last quarter of the century.

Anders Sandberg is wrong about basically everything to do with uploading.

See 15:30 of this talk, Anders' Monte Carlo simulation (assumptions debatable, obviously) is a wide curve with a center around 2075. Separately Anders expresses nontrivial uncertainty about the brain model/cognitive neuroscience step, setting aside the views of the non-Anders population.

You're the first halfway-sane person I've ever heard put the median at 2100.

I didn't say 87 years, but closer to 87 than 32 (or 16, for Kurzweil's prediction of a Turing-Test passing AI).

I said "near the end of the century" contrasted to a prediction of intelligence explosion in 2045.

[-][anonymous]12y00

Well atom-size features are scheduled to come along on that time-scale, believed to mark the end of scaling feature size downwards.

A very tangential point, but in his 1998 book Robot, Hans Moravec speculates about atoms made from alternative subatomic particles that are smaller and able to absorb, transmit and emit more energy than the versions made from electrons and protons.

[This comment is no longer endorsed by its author]Reply

[-]Baughn12y-10

press releases

Here's one: http://phys.org/news/2012-08-d-wave-quantum-method-protein-problem.html

That doesn't apply to large proteins yet, but it doesn't make me optimistic about the nanotech timeline. (Which is to say, it makes me update in favor of faster R&D.)

[-]CarlShulman12y60

http://blogs.nature.com/news/2012/08/d-wave-quantum-computer-solves-protein-folding-problem.html

It’s also worth pointing that conventional computers could already solve these particular protein folding problems.

You have a computer doing something we could already do, but less efficiently than existing methods, which have not been impressively useful themselves?

ETA: https://plus.google.com/103530621949492999968/posts/U11X8sec1pU

[-]Baughn12y00

The G+ post explains what it's good for pretty well, doesn't it?

It's not a dramatic improvement (yet), but it's a larger potential speedup than anything else I've seen on the protein-folding problem lately.

[-]CarlShulman10y00

You can duplicate that D-Wave machine on a laptop.

[-]Baughn10y00

True, but somewhat besides the point; it's the asymptotic speedup that's interesting.

...you know, assuming the thing actually does what they claim it does. sigh

[-]CarlShulman10y00

Also no asymptotic speedup.

[-]Eliezer Yudkowsky12y40

Nobody believes in D-Wave.

[-]Shmi12y30

That seems like an oversimplification. Clearly some people do.

Scott Aaronson:

“I no longer feel like playing an adversarial role. I really, genuinely hope D-Wave succeeds.” That said, he noted that D-Wave still hadn’t provided proof of a critical test of quantum computing.

I am not qualified to judge whether the D-Wave's claim that they use quantum annealing, rather than the standard simulated annealing (as Scott suspects) in their adiabatic quantum computing is justified. However, the lack of independent replication of their claims is disconcerting.

[-]Kawoomba12y30

However, the lack of independent replication of their claims is disconcerting.

Maybe they could get Andrea Rossi to confirm.

[-]JoshuaFox12y130

This is puzzling.

I had thought that the question of AI timelines was so central that the core SI research community would have long since Aumannated and come to a consensus probability distribution.

Anyway, good you're doing it now.

[-]Eliezer Yudkowsky12y70

Maybe I was absent from the office that day? I hadn't heard Carl's 2083 estimate (I recently asked him in person what the actual median was, and he averaged his last several predictions together to get 2083) until now, and it was indeed outside what I thought was our Aumann-range, hence my surprise.

[-]Paul Crowley12y70

It seems like the sort of thing people would plan to do on a day you were going to be in the office.

[-]CarlShulman12y00

We had discussed timelines to this effect last year.

[-]Shmi12y60

I'm wondering why this is stated as a conjunction. Would a single failure here really result in an early AGI development?

[-][anonymous]12y00

If I go in the garage and observe that the floor is wet, I would update in the direction of

it rained last night; and
Frank left the garage door open again; and
the tools the boys negligently left outside in the grass all night got rusty.

But that of course does not mean that if the tools had not gotten rusty, the garage floor would not have gotten wet.

In other words, Eliezer was writing about statistical relationships, and you seem to have mistaken them for causal relationships.

[This comment is no longer endorsed by its author]Reply

[-]Eliezer Yudkowsky12y00

BTW regarding Robin's AI progress metric, my reaction is more like Doug's (the first / most upvoted comment).

[-]CarlShulman12y30

I agree with that comment that machine learning has been on a roll, but Robin's reply is important too. We can ask how machine learning shows up in the performance statistics for particular tasks to think about its relative contribution.

[-]Nic_Smith12y20

A small correction: The Society for Venturism has been around for quite a while, although I have a vague impression they've been more active in the last year than in the past. I had a look at their site to see when they were founded (1986), and noticed they're currently raising funds for someone else, Aaron Winborn.

[-]ahartell12y00

Thanks, updated.

[-]nigerweiss12y20

That's got to be close to a best case suspension. I wish her nothing but the best.

[-]hankx778712y10

We did it!

[-]lsparrish12y00

Some mass media coverage here. Also this video features her (religious) mother explaining the reasoning behind the head-only thing and how she came to terms with it.

[-]hankx778712y00

"If god has given us the brains to figure this stuff out, then who's to say what plans he has once we have figured it out?" - Jane Suozzi on cryonics

[-]curiousepic12y00

It will be interesting to read the case report if/when it's posted.

[+]advancedatheist12y-210

[+]advancedatheist12y-320

Moderation Log