This post is probably hazardous for one type of person in one particular growth stage, and necessary for people in a different growth stage, and I don't really know how to tell the difference in advance.

If you read it and feel like it kinda wrecked you, send me a DM. I'll try to help bandage it. 


One of my favorite stories growing up was Star Wars: Traitor, by Matthew Stover.

The book is short, if you want to read it. Spoilers follow. (I took a look at it again recently and I think it didn't obviously hold up as real adult fiction, although quite good if you haven't yet had your mind blown that many times)

One anecdote from the story has stayed with me and permeates my worldview.

The story begins with "Jacen Solo has been captured, and is being tortured."

He is being extremely tortured. He's in a white room, with a device connected throughout his nervous system, inflicting maximum white-hot agony. Whenever the suffering becomes so great that his body tunes it out, it gives him just enough time to relax to hurt all the more when it abruptly starts up again. 

Every day, an alien woman comes to visit him. She talks to him, during lulls in the torture, about philosophy and life and history. She asks him what he thinks about things. He says "I think I'm being fucking tortured. Can you please help?", and she kind of ignores him and goes on talking about philosophy and life and history and stuff. Sometimes he tries more clever ways to pry information out of her, to no avail.

After several weeks (or months?) of this, at some point he asks again "Seriously what the fuck? Who are you? What is happening to me? Why are you torturing me, or, not helping? What is going on?"

She says: "Do you know what a shadowmoth is?"

"Answer my fucking question"

"Do you know what a shadowmoth is?"

"Fine, a shadowmoth is a life form native to Coruscant. They're silicon-based, their wingflutes make music once they leave the cocoon and can fly."

She nods, and says "Once, I saw a shadowmoth in its cocoon, struggling. Like you, I am sensitive to the force – I didn't merely empathize with it, but I felt it. When shadowmoths strive to break free from their cocoon, they are in pain. I felt it's pain. And I felt it's envy of the other moths, already free, flying, making music. I wanted to help it."

Jacen shudders. "Oh no, you didn't –"

"Yes. I cut it free."

"No –"

"It sounds like you know what happened next?"

Jacen says: "If they don't escape from the cocoon on their own, they'll never be strong enough to fly, and they suffer and starve to death, worse than what they were experiencing in the cocoon."

"Indeed."[1]

The two of them sit for awhile. The torture machine gives Jacen another wave of White Pain. Then the woman says "Suppose you did want to help a shadowmoth. What would you do, if you couldn't cut it free? You might sit with it, and let it know that it's not alone, and that it's pain is in the service of it's destiny."

And then she leaves for the day.

And, then, it occurs to Jacen:

It's been months. They haven't asked him any questions. There is no indication that they particularly want anything from him. There is no indication that the White Hot Torture will ever stop.

What would he do, if this was literally the only thing there would ever be? Just him, and the White, and this inscrutable alien woman...

...basically, the only action he can do, is to change his relational stance to the torture, and learn to stop caring about it.

The last sentence of that chapter is "Jacen Solo begins to eat away at the White."

...

A few weeks later, he has basically invented Buddhist Enlightenment from first principles. He feels the pain, but does not suffer. He converses freely with the woman about philosophy and history and life and stuff.

And, then, his captors say "Congratulations. You have passed the first test. You are now ready for the second phase of your training."[2]


Now, there are a few things I have to say about this.

First, to forestall the obvious objections: The transhumanist answer to "what if painful suffering is necessary to learn valuable life lessons?" is "skill issue." 

If you can't figure out how to let shadowmoths out of cocoons without them suffering and dying, maybe you can just invent better biotech until this is no longer possible. In meantime, sure, have some equanimity about it. But don't let that equanimity stop you from trying to improve the world.

But, better biotech might take thousands of years (or, like, at least a decade) to invent, and you might have to deal with a situation in the meanwhile anyway. And I do think there is something powerful here about never losing your locus of control. And there’s something important about "Sometimes, at least for now, the best way to learn some things involves struggling and figuring things out for yourself. Teachers can help point you to the door but you'll have to walk through it yourself."

There are two particular angles that have felt frequently relevant over the past two years.

The first angle is metastrategy

The goal of my rationality training investigation is not to produce people who are good at researching a particular domain, or solving a particular class of problem. If you are working in a known field, the thing to do is find experts in that field and learn from them. Sometimes they may need to improve their pedagogy, or learn to articulate their tacit knowledge better. You can learn to extract tacit knowledge from people, and you can learn to extract more knowledge from textbooks, etc.

But, for problems we don't understand yet, there may just not be an established field to learn from.

There, you need the skill of either inventing new skills, or connecting dots between disparate existing fields that nobody has yet integrated. I think you need some kind of generalized research taste, that tells you what to do when nobody in the world is capable of authoritatively giving you the answer, and the specialized research tastes of various fields might be subtly leading you astray, like a physicist assuming they can model everything as spherical cows, or an ML researcher assuming they can continue to be behaviorist about their research as they push the frontier towards superintelligence.

For this reason, my training is very "shadowmoth-y". Much of my process is "make people solve a problem they don't know how to solve, and challenge them to figure it out." 

I think there is some art to being "exactly the right amount of cryptic and annoying", and to finding problems that form a reasonable difficulty curve for people with various different starting skills. I don't know that I've hit this balance well yet. The transhumanist answer to shadowmothism still applies – if I can give people clues that help them learn the right metaskills without being so painful and annoying, all the better. 

But I try, where possible, to only give people the earliest hints on a thought chain, nudging them towards the right metatools to invent/remember the right metatools to find/remember the right object level tools to solve a given problem.

The second angle is something like "resilient self-ownership and locus of control."

Long ago, a friend of mine had recently emotionally grokked existential risk – he had known about and "believed in" it for years, but somehow this particular week things clicked and he was feeling more of the full force of it. He felt very afraid, and didn't know what to do.

He asked a mentor for advice. She asked "What does the fear feel like?"

He didn't articulate anything very clearly.

She followed up with "Does it feel more like a tiger is chasing you, or more like you want to curl up and hope that your parents come and fix it?"

"The second one."

She nodded. "I think that kind of fear does make sense in the ancestral environment (and often today). Sometimes you're afraid and it is the right thing to do to get help, and maybe curl up to conserve resources meanwhile.

"The thing is, though, that your parents really can't help you here. Mom can’t stop x-risk. So, that kind of fear... it just isn't very useful."

I can imagine people for whom this would be exactly the wrong thing to say. But, my friend nodded, and... something subsided in him. Fully understanding what the fear was for, and why it wasn't helpful, allowed him to process and let go of it. 

"Fully understanding an emotion such that you can let it go" is actually a separate topic, which deserves it's own post. For now, I'm bringing this up because the move of: "Oh, my [parents/friends/society] actually really won't save me here, I have to somehow change something inside myself instead of waiting, or trying to change something outside myself" is an important move to be capable of making sometimes.

This played a role in the first Major Grieving that kicked off my interest in Deliberate Grieving – I thought someone had wronged me. I wanted my peer group to somehow decide either that yes, they had wronged me, and express that judgment. Or, judge that "actually, so-and-so really didn't actually wrong Raemon, this is Raemon's job to adjust to." Or something.

But, this was during the pandemic, and my peer group was busy dealing with their own problems, and it really didn't make sense to call a tribunal about it. 

What if social reality just wasn't going to issue a verdict here?

What would I do?

In that case, the thing to do was grieve. Recognize that yes, there was some legitimate reason that having Justice here would be right and good, but that it wasn't going to happen. And let go somehow.

More recently, I was dealing with an exhausting series of problems, and talking to a friend who was experiencing a very similar set of problems. I found myself saying "I want you... I want you to say that I'm Good. To say that I've done enough."[3]

And my friend sadly said "Yeah. I also want someone to say that to me, Ray. 

"The thing is, getting that from outside isn't ever really enough. I think you need to somehow become the sort of person who decides for themselves whether they're good enough, and to not need it from some kind of external validation."

Fuck.

What if there would never be someone I trusted who could tell me I was Good Enough, that things were in some sense Okay

What if I had to learn to do that myself? 

Or, worse, what if I had to really acknowledge that it was the wrong question to ask?


I think, for many people, it's important at some point to gain a true sort of independence, the way these fables and anecdotes gesture at. The Shadowmoth Struggle is still, often, a necessary part of reality.

The transhumanist rejoinder is still important. Sometimes your friends can help you. Sometimes you can invent better pedagogical techniques, or just actually tell someone they're Good Enough in a way that lands and that their soul really believes and updates on in an enduring way. We're social creatures. I'm pretty sure my human values ultimately say: it is good for people to help each other in this way.

But, I think it is also a worthwhile goal, to be the sort of person capable of enduring and growing and striving, even if at the moment you are an island.

Dig through the cocoon, such that your wings might make music in the skies of distant planets.

 

        It matters not how strait the gate,
        How charged with punishments the scroll,
.       I am the master of my fate,
        I am the locus of control.

                              – Kenzie Amodei

 

  1. ^

    The metaphor of "moths struggling to escape a cocoon and needing to do so on their own" also shows up in the TV show Lost, but, in the relevant episode, the metaphor ends here, right before we get to the important bit.

  2. ^

    The second phase of his training is also fairly interesting. The rest of the book was mostly forgettable (in that I literally have completely forgotten it), although the very last sentence was also important to me so maybe it's worth it for that.

  3. ^

    I want to add: I have had people tell me this, and it was helpful. Or otherwise help my struggles feel "seen" and respected. But there was something impermanent and incomplete about it.

New Comment
3 comments, sorted by Click to highlight new comments since:

At the beginning of the post, I wrote:

 

"This post is probably hazardous for one type of person in one particular growth stage, and necessary for people in a different growth stage, and I don't really know how to tell the difference in advance.

If you read it and feel like it kinda wrecked you send me a DM. I'll try to help bandage it. "

 

I thought about putting it again at the end, where people would actually be more likely to see it when they realized they needed it. But, also, it felt like it would undercut the poetic heft of the end of the post. But then I realized I could put it in the comments here, which feels like a reasonable middle ground.

I can't remember whether it's Jacen, or the woman, who goes on to say "you might sit with it, and let it know that it's not alone, and do what you can to comfort it."

"'And also, perhaps,' [the woman] went on, 'you might stop by from time to time, to let the struggling, desperate, suffering creature know that it is not alone. That someone cares. That its pain is in the service of its destiny.'"

It's the woman.

And also I guess I'd like to register another weird coincidence, Traitor was also one of my favourite stories growing up. I disagree with you about the second half of the book being forgettable though. Ganner Rhysode also felt important.

Gosh that was really beautifully written