Comment Permalink

Nikola Jurkovic1y7412

I'm not worried about OAI not being able to solve the rocket alignment problem in time. Risks from asteroids accidentally hitting the earth (instead of getting into a delicate low-earth orbit) are purely speculative.

You might say "but there are clear historical cases where asteroids hit the earth and caused catastrophes", but I think geological evolution is just a really bad reference class for this type of thinking. After all, we are directing the asteroid this time, not geological evolution.

Showing 3 of 4 replies (Click to show all)

Linch1y*318

Open Asteroid Impact strongly disagrees with this line of thinking. Our theory of change relies on many asteroids filled with precious minerals hitting earth, as mining in space (even LEO) is prohibitively expensive compared to on-ground mining.

While your claims may be true for small asteroids, we strongly believe that scale is all you need. Over time, sufficiently large, and sufficiently many, asteroids can solve the problem of specific asteroids not successfully impacting Earth.

17ryan_greenblatt1y

This paragraph gives me bad vibes. I feel like it's mocking particular people in an unhelpful way. It doesn't feel to me like constructively poking fun at an argument and instead feels more like dunking on a strawman of the outgroup. (I also have this complaint to some extent with the top level "Open Asteroid Impact" April Fool's post, though I think the vibes are much less bad for the overall post. This is due to various reasons I have a hard time articulating.)

15[anonymous]1y

It comes from the discussion here: https://www.lesswrong.com/posts/LvKDMWQ3yLG9R3gHw/empiricism-as-anti-epistemology which also has https://www.lesswrong.com/posts/hvz9qjWyv8cLX9JJR/evolution-provides-no-evidence-for-the-sharp-left-turn as a related topic. As near as I can summarize the arguments, the argument distills to : What intelligence in any thinking agent does : A. Perceive the situation at present. It will functionally always be unique in the real world. (it will never exact match to a Q-table entry with a few exceptions like board games) B. Lookup reference classes that are similar to the situation you are in. C. Use the reference classes that are similar to the situation, and assume the laws of physics will cause a similar outcome now as to then, predict the future outcomes conditional on the agent's actions. (aka I do nothing, reality will cause outcome 1, I do action A, reality will cause outcome 2...) (D. choose the action that predicts the future with the highest EV from the agent's perspective) This will fail badly when the situation is a black swan. For example, at one point I sold 80! bitcoins for $10 each because I reasoned that it was similar to fake experimental e-currencies that had been tried in the past. How you can project the future: So when people try to answer questions like 'will there be a recession' and similar, that's how. You try to find a reference class, or a numerical variable that predicted '15 of the last 10 recessions' and project it will happen when this happens. The argument for "AI won't be that bad" comes to reasoning: A. A piece of software we call a transformers model is kinda like the reference classes "useful software", "useful technology tools", "military applicable technology". B. You then assume the laws of physics are similar, and assume the other tens of thousands of things that match the above will cause a similar out

See in context

336 [April Fools' Day] Introducing Open Asteroid Impact

by Linch

1st Apr 2024

1 min read

336

This is a linkpost for https://openasteroidimpact.org/

“That which does not kill us makes us stronger.”

Hillary Clinton, who is still alive

I'm proud and excited to announce the founding of my new startup, Open Asteroid Impact, where we redirect asteroids towards Earth for the benefit of humanity. Our mission is to have as high an impact as possible.

Below, I've copied over the one-pager I've sent potential investors and early employees:

Name: Open Asteroid Impact

Launch Date: April 1 2024

Website: openasteroidimpact.org

Mission: To have as high an impact as possible

Pitch: We are an asteroid mining company. When most people think about asteroid mining, they think of getting all the mining equipment to space and carefully mining and refining ore in space, before bringing the ore back down in a controlled landing. But humanity has zero experience in Zero-G mining in the vacuum of space. This is obviously very inefficient. Instead, it’s much more efficient to bring the asteroids down to Earth first, and mine it on the ground.

Furthermore, we are first and foremost an asteroid mining *safety* company. That is why we need to race as fast as possible to be at the forefront of asteroid redirection, so more dangerous companies don’t get there before us, letting us set safety standards.

Cofounder and CEO: Linch Zhang

Other employees: Austin Chen (CTO), Zach Weinersmith (Chief Culinary Officer), Annie Vu (ESG Analyst)

Board: tbd

Competitors: DeepMine, Anthropocene

Valuation: Astronomical

Design Principles: Bigger, Faster, Safer

Organizational Structure: for-profit C corp owned by B corp owned by public benefit corporation owned by 501c4 owned by 501c3 with a charter set through a combination of regulations from Imperial France, tlatoani Aztec Monarchy, Incan federalism, and Qin-dynasty China to avoid problems with Arrow’s Impossibility Theorem

Safety Statement: “Mitigating the risk of extinction from human-directed asteroids should be a global priority alongside other civilizational risks such as nuclear war and artificial general intelligence”

You can learn more about us on our website.

April Fool's

Frontpage

336

Mentioned in

49AI #58: Stargate AGI

New Comment

29 comments, sorted by

top scoring

Click to highlight new comments since: Today at 9:48 AM

[-]Nikola Jurkovic1y7412

[-]gwern1y*3815

Risks from asteroids accidentally hitting the earth (instead of getting into a delicate low-earth orbit) are purely speculative.

Not to mention that simple counting arguments show that the volume of the Earth is much smaller than even a rather narrow spherical shell of space around the Earth. Most asteroid trajectories that come anywhere near Earth will pass through this spherical shell rather than the Earth volume.

Remember - "Earth is not the optimized-trajectory target"! An agent like Open Asteroid Impact is merely executing policies involving business strategies involving asteroids which have been (financially) rewarded in the past; it in no way attempts to 'optimize impact'.

And the lack of optimization is a killer because impacts just wouldn't happen. The idea that asteroids will ever impact ignores the simple fact that the Solar System has chaotic dynamics - it is not just a '3-body problem' but an n-body problem where n = millions. Imagine trying to predict that! And consider the simple problem of landing the same rocket you launched: as of November 2015, no one has ever succeeded in this, because everything involved is super-chaotic. (Just imagine the sheer level of chaos of a multi-ton rocket perched over exploding exhaust while descending through chaotic weather, right down to the millisecond timescale; you might as well balance a pencil on the tip of a pencil.) Grifting tech hypebros would have you believe that 'technology improves', sometimes rapidly, and that by now we might be landing rockets on - if you believe absurd exponential forecasts - a near-daily basis. Such claims are not even worth factchecking.

[-]Linch1y*318

[-]ryan_greenblatt1y*17-19

You might say "but there are clear historical cases where asteroids hit the earth and caused catastrophes", but I think geological evolution is just a really bad reference class for this type of thinking. After all, we are directing the asteroid this time, not geological evolution.

This paragraph gives me bad vibes. I feel like it's mocking particular people in an unhelpful way.

It doesn't feel to me like constructively poking fun at an argument and instead feels more like dunking on a strawman of the outgroup.

(I also have this complaint to some extent with the top level "Open Asteroid Impact" April Fool's post, though I think the vibes are much less bad for the overall post. This is due to various reasons I have a hard time articulating.)

[-][anonymous]1y150

It comes from the discussion here: https://www.lesswrong.com/posts/LvKDMWQ3yLG9R3gHw/empiricism-as-anti-epistemology

which also has https://www.lesswrong.com/posts/hvz9qjWyv8cLX9JJR/evolution-provides-no-evidence-for-the-sharp-left-turn as a related topic.

As near as I can summarize the arguments, the argument distills to :

What intelligence in any thinking agent does :

A. Perceive the situation at present. It will functionally always be unique in the real world. (it will never exact match to a Q-table entry with a few exceptions like board games)

B. Lookup reference classes that are similar to the situation you are in.

C. Use the reference classes that are similar to the situation, and assume the laws of physics will cause a similar outcome now as to then, predict the future outcomes conditional on the agent's actions. (aka I do nothing, reality will cause outcome 1, I do action A, reality will cause outcome 2...) (D. choose the action that predicts the future with the highest EV from the agent's perspective)

This will fail badly when the situation is a black swan.

For example, at one point I sold 80! bitcoins for $10 each because I reasoned that it was similar to fake experimental e-currencies that had been tried in the past.

How you can project the future:

So when people try to answer questions like 'will there be a recession' and similar, that's how. You try to find a reference class, or a numerical variable that predicted '15 of the last 10 recessions' and project it will happen when this happens.

The argument for "AI won't be that bad" comes to reasoning:

A. A piece of software we call a transformers model is kinda like the reference classes "useful software", "useful technology tools", "military applicable technology".

B. You then assume the laws of physics are similar, and assume the other tens of thousands of things that match the above will cause a similar outcome, and there you go, almost 0% AI doom because none of the other technologies risked the doom of humanity (except 1-2). And also you hit a corollary, we know historically that countries that didn't adopt the latest and most expensive military technology got slaughtered. Recent examples : Afghanistan invaded by the Soviets, then later the USA. Iraq hit by the USA twice. Ukraine.

And we see the results in Ukraine what even a little bit of better weapons technology donated to their side does on the battlefield, the results are dramatic. This results in another pro-AI argument, "we didn't really have a choice".

The counterargument:

The simplest counterargument to above is to say "AI, especially ASI, doesn't match the reference classes of "useful software", "useful technology tools", "military applicable technology".

A. useful software counter: https://www.lesswrong.com/posts/kSq5qiafd6SqQoJWv/ by @Davidmanheim

B. "useful technology tools" : the argument here is usually that the ASI isn't a tool because it can betray you while a hammer can't. Also it's smarter than yourself, so you can't really even check it's work or know when it's betraying.

C. "military applicable technology" : ditto, you can't trust a weapon that can think for itself or coordinate to betray you

This thread:

The "in joke" is that we all know that slamming an asteroid into the earth and causing a > 1 gigaton explosion of plasma and probably an earthquake (I checked and it's a tiny asteroid to reach 1 gigaton) is something that we know the consequences for. It really is a bad idea and if we need platinum or iridium or other elements common to asteroids we'll have to process it in place and bring it back the hard way.

So we're trying to play with the "reference class" to make it seem like a good idea among other purposeful argument faults. This one is making fun of people saying the asteroid fits the 'reference class' of the one that extincted the dinosaurs and that most doom advocates, unlike yourself, aren't qualified in ML.

Mine tries to say that because the reference class data is old, we should get into the business of slamming asteroids and find out the consequences later, and I also make the military applicable tech argument, which is a true argument : if you want to stop people deorbiting asteroids from out past the orbit of Mars, you need space warships and vehicles that can redirect asteroids on an impact course away. (so the same technology as the bad guys, meaning you cannot afford a 'spacecraft building pause')

I also made fun of Sam Altman's double dealing.

[-]Unnamed1y5025

A lot of people have this sci-fi image, like something out of Deep Impact, Armageddon, Don't Look Up, or Minus, of a single large asteroid hurtling towards Earth to wreak massive destruction. Or even massive vengeance, as if it was a punishment for our sins.

But realistically, as the field of asteroid collection gradually advances, we're going to be facing many incoming asteroids which will interact with each other in complicated ways, and whose forces will to a large extent balance each other out.

Yet doomers are somehow supremely confident in how the future will go, foretelling catastrophe. And if you poke at their justifications, they won't offer precise physical models of these many-body interactions, just these mythic stories of Earth vs. a monolithic celestial body.

[-]roha1y174

If everyone has his own asteroid impact, earth will not be displaced because the impulse vectors will cancel each other out on average*. This is important because it will keep the trajectory equilibrium of earth, which we know since ages from animals jumping up and down all the time around the globe in their games of survival. If only a few central players get asteroid impacts it's actually less safe! Safety advocates might actually cause the very outcomes that they fear!

*I've a degree in quantum physics and can derive everything from my model of the universe. This includes moral and political imperatives that physics dictate and thus most physicists advocate for.

[-][anonymous]1y*4613

It's important to start crashing asteroids into the planet now, before there is a spacecraft overhang and potentially many asteroids could be deorbited at the same time. This gives us the opportunity to learn about any dangers from asteroid impact. A great many doomers claim it will kick dust into the atmosphere and cause global cooling, or that gigaton explosions on impact are untested and risk causing damage, but they have no recent empirical evidence.

All we have is some fossils and 66 million year old data! Let's find out what really happens empirically. Move fast and break things. Think of all the benefits.

In other related news, I've got a tender offer with some unnamed funders to start an 8 Trillion heavy spacecraft manufacturing venture. This will pay for facilities earth and moonside to construct spacecraft with the capabilities to move larger asteroids than ever before.

https://twitter.com/robertwiblin/status/1758251292131053637

In any case, we don't have a choice. It's a race. Our only chance to survive the future in this situation is to have our own warships and asteroid movers in space as well, or hide under the umbrella of allies who do...

[-]Bridgett Kay1y329

We don't know how to align asteroids' trajectories, so it's important to use smaller asteroids to align larger ones- like a very large game of amateur billiards.

[-]VojtaKovarik1y*274

I believe that a promising safety strategy for the larger asteroids is to put them in a secure box prior to them landing on earth. That way, the asteroid is -- provably -- guaranteed to have no negative impact on earth.

Proof:

| | | | | | | |
v v v v v v v v
__________ CC
| ___ | CCCC
| / O O \ | :-) CCC :-)
| | o C o | | _|_ || o _|_
| \ o _ / | | ||/ |
|_________ | /\ || /\
--------------------------------------------------------
□

[-]Jiro1y177

I'm going to be a party pooper here and point out that though this may be presented as an April Fool's joke, its main joke is that in a live debate, it is extremely funny to strawman your opponent's side. That's bad practice whether done as a joke or not.

[-]Garrett Baker1y130

This is patently absurd. The vast majority of asteroids are incredibly small, and would most likely burn up in the upper atmosphere. Your chances of finding a large one are incredibly small, even assuming you can locate & get to an asteroid in the first place. In order to even get to the asteroids, and protect them on the way down, your ship would need to be bigger than them!

Don't get me wrong, you may make a few bucks from iron mining, but claiming to be in a "race" or that "safety" is a concern? Please.

[-]roha1y150

We are decades if not centuries away from developing true asteroid impacts.

[-]Garrett Baker1y131

I put together this quick problem factorization, and I don't think the numbers come back all that impressive:

Locate asteroid (<1%, much of the space in space is not an asteroid)
Get to asteroid (<1%, as in 1, since you have the same problems as 1 even if you know where the asteroid is)
Get back to earth (<1%, as in 1 and 2, essentially the same problems as 1 and 2, most of space isn't the Earth)
Get the asteroid through the atmosphere (5%, the asteroid would likely burn up, but perhaps you have a solution for that)
Locate the asteroid on Earth (<25%, most of Earth is not asteroid, but you could use a GPS for this one. The problem is the asteroid may land in a location you don't have free access to, like... I don't know, anywhere in the ocean? If it lands in the ocean, because its made of rock, it will surely sink, and that itself will be an entirely new endeavor)

[-]Ilio1y80

the asteroid would likely burn up, but perhaps you have a solution for that

Yes, there’s a well known solution: just make the asteroid fast enough, and it will burn less in the atmosphere.

[-]roha1y120

Given all the potential benefits there is no way we are not going to redirect asteroids to earth. Everybody will have an abundance of rare elements.

xlr8

[-]Linch1y137

rare earth metals? More like common space metals, amirite?

[-]magic9mushroom1y90

Amusingly, "rare earths" are actually concentrated in the crust compared to universal abundance and thus would make awful candidates for asteroid mining, while "tellurium", literally named after the Earth, is an atmophile/siderophile element with extreme depletion in the crust and one of the best candidates.

[-]Linch1y20

Thanks for the pro-tip! I'm not much of a geologist, more of an ideas guy^[1] myself.

^{^}
"I can handle the business end"

[-]Nicholas / Heather Kross1y100

I will carefully hedge my investment in this company by giving it $325823e7589245728439572380945237894273489, in exchange for a board seat so I can keep an eye on it.

[-]quiet_NaN1y70

I think you are seriously underselling OAI. Asteroid impacts have the potential to solve many of the looming humanitarian and existential crisis:

Asteroid impacts are a prime candidate to stop global warming.
The x-risk from AI is much lower in timeline where OAI succeeds.

Basically, OAI is a magic bullet, which could enable a phase change in human technology. Global poverty will no longer be a thing. The Near East conflict will be solved. It will prevent Putin from conquering Ukraine and keep Taiwan out of the hands of China. It will end all colonialism and discrimination.

[-]RamblinDash1y20

Asteroid impacts are a prime candidate to stop global warming.

I dunno man, Randall Munroe thinks that they would cause global warming.

[-]quiet_NaN1y50

Well, I think Munroe is not thinking big enough here.

Of course, this might increase global warming in the long run because the impact crater can produce CO2 from both of the global firestorms devastating plant life and the destruction of carbonate rock in the earth mantle, but I think that this can be minimized by choosing a suitable impact location (which was not a concern for Chicxulub) and is partly offset by a decline in fossil fuel use due to indirect effects. Also, all of the tipping point factors in climate change would work to our advantage: larger polar caps reflect more light, more permafrost binds more CO2 and so on.

At the worst, climate engineering might require periodic impacts on a scale of one per decade, which seems sustainable.

[-]Ben Pace1y74

This signature made me laugh:

Chicxulub - Kill many birds with one stone

Also, if you haven't done so before, I recommend googling 'Chicxulub'.

[-]Nicholas / Heather Kross1y61

I have over 5 Twitter followers, I'll take my board seat when ur ready

[-]scrollop1y4-2

Rather than quickly developing large spacecraft that could rapidly intercept and guide asteroids for impact at a suitable location for mining (Canada?), would it be easier to instead alter the trajectory of the earth ("Calling all boffins! You were jealous of Oppenheimer's gang - now it's your turn!") to collide with various asteroids?

Maybe we explode all of the world's nuclear weapons in the atmosphere at one point which may suitably nudge the earth and thus aim the asteroid at a globally chosen "catcher's mitt" impact zone (Canada?), surrounded by eager bulldozers ready for the pickings.

[-]Linch1y30

Alas I think doing this will be prohibitively expensive/technologically infeasible. We did some BOTECs at the launch party and even just getting rid of leap seconds was too expensive for us.

That's one of many reasons why I'm trying to raise 7 trillion dollars.

[-]quiet_NaN1y20

All the doomers (who are mostly white male nerds who read too much scifi) complaining that large asteroid impacts could cause catastrophic climate changes are distracting from the real problem, which is that meteorite impacts TODAY are a tool of oppression used by privileged able-bodied white cis-men.

STEM people claim that there is no proof that asteroids disproportionally hit minorities, but a more compassionate analysis clearly proves them wrong.

Regarding direct impacts, it is clear that healthy men are more likely to dodge an meteorite than the malnourished, wheelchair-bound or women and children. Better health care services in Western countries can further improve the survival odds for the minority of privileged people subjected to asteroid hits, leaving disadvantaged minorities to pay the price.

Looking at https://openasteroidimpact.org/ is it clear that these are the same crowd of Silicon Valley techbros which are responsible for most of the problems in the world. They quote two deities (talk about privilege!) and a bunch of white people. Their board seems to be disproportionally White (and Asian) and male. No statement of diversity and inclusion.

I think we should therefore shame OAI and its competitors to include mechanisms to their asteroid steering which will further social and racial justice by redirecting some of the profits from the metals to disadvantaged minorities while also making sure that the impact deaths are fairly distributed between different ethnicities.

[-]Review Bot1y*10

The LessWrong Review runs every year to select the posts that have most stood the test of time. This post is not yet eligible for review, but will be at the end of 2025. The top fifty or so posts are featured prominently on the site throughout the year.

Hopefully, the review is better than karma at judging enduring value. If we have accurate prediction markets on the review results, maybe we can have better incentives on LessWrong today. Will this post make the top fifty?

Moderation Log