I appreciate you writing this sequence. Here's why:
- I thought the flow of it was pretty smooth (which is helpful when you struggle with EF, obviously) - I esp enjoyed the fact that you maintained a clear enough map of where you were going at a couple of different levels at basically all times.
- I got a lot out of your content, mostly in terms of 'cool, I now have an easily accessible and pretty intuitive rough structure in mind of what might be going on when I get stuck and which ways the causal arrows point', which I hadn't taken the time/didn't have the bandwidth to figure out/research myself.
- you made connections with frameworks from adjacent fields and examples that spoke to me effortlessly (relevant level of abstraction, etc) and enriched my toolbox.
Thanks esp for the times you shared your personal experiences, offered a bit of your own speculation (I think?) - and pushed through when you struggled to show up to write.
Quick responses to the questions you asked:
Thank you for this post.
The only thing about which I want to encourage more reflection is Have more "Move fast and break things" attitude [admittedly there is a bit of context I'm not edit-pasting here, but you do seem to favour this approach to a fair extent].
My gentle nudge here is based on my sense that 'moving fast and breaking things' can have pretty bad consequences if you're (collaboratively) exploring AI safety research tracks that recklessly put into circulation knowledge that can be used to increase capabilities over/without safety 'points'.
@author - thank you for this fascinating exploration. I'm appreciating your intuition that there might be some interesting structures there and your ability to point to their shape through this research. It seems helpful to have some sense of the ways LLM may exhibit features/behaviours/geographies that we didn't knowingly 'put there' and that are not easily noticeable.
@Shayne - Can you expand on 'Literary analysis however probably works dramatically better. Thus maybe it might be worth looking at the works of literature critics'?
From what I'm understanding of what your comment is caring for, I don't actually think that the approach you're suggesting here gets you richer/more meaningful findings - structuralism provides its own extremely context-specific (both in time and culture) framing of the symbolic meaning landscape it's concerned with. By comparison, the archetypes you find in the major arcana are pretty steeped in the cultural roots that have underpinned much of the you're proposing to scrutinise instead, and is made up of figures that would have been more foundationally influential in the substrate of today's Western culture (especially with its combination of cosmological influences). Therefore, it seems to me from the way you've phrased your comment that you would propose a shallower tool, essentially, which doesn't strike me as more helpful in making sense of how an LLM might derive a blueprint of human cosmology.
Also, if the data that shaped the embedding space was all English language text, I think we're lying to ourselves somewhat if we're expecting a diverse, non-Western-centric cosmology to emerge from this kind of analysis. I agree with you that using Lévi-Strauss' frameworks as another track could still be worthwhile, but heeding the previous sentence rather than thinking that the right lens can cure a lack that's actually in the object we're exploring.
Finally, can you clarify what you mean by your very first observation, please?
One point I want to add to my previous comment:
I think it's possible that 'fear of failure + fear of difficulty' doesn't fully explain why people struggle to start/continue an action.
In fact, I think there's a third reason, one that's fuzzier and therefore perhaps somewhat more delicate to deal with which at least I encounter: I'm often vaguely aware (intuitively/not quite consciously) that a/some second-order consequence(s) will be impacted if I undertake the action, or if I undertake the action before obtaining more information, mustering up sharper focus etc (yes, I realise this is exactly how one might rationalise procrastinating, only about something that isn't the core object). This is esp true if there's a general sense of uncertainty about various ramifications of my executing/prioritising/executing in a particular way the action in question.
As context, this is something that's become true for me in the course of heavy burnout. Quite simply, I lost confidence in my ability to effectively track ALL the things (hypervigilant? Me? What do you mean, overoptimising isn't optimal?), which caused a bunch of paralysis. I'm working on it; simply becoming aware of these kinds of patterns has helped me tremendously. I think it's worth recognising the impact such mechanisms can have, at least for people who struggle to trust their focus/discernment, either temporarily like me or possibly chronically, if that's a thing for really anxious people.
I think there's a way this failure mode can be rolled into your 'failure or difficulty' model, by conceptualising this as a subset of the potential failure or difficulty that may arise if you undertake the action.