the entire brain and body needs to get built by a mere 25,000 genes. My current low-confidence feeling is that reasonably-comprehensive pseudocode for the human hypothalamus would be maybe a few thousand lines long.
That confirms what I have been getting around to over time: Human instincts and motivational systems are probably built from few elements. I used to think that there are hard-wired motivations/interests for specific types of sports or hobbies or people and how this could be coded for. But after reading Steven's sequence, I look more for simple patterns like geometric features, hormonal triggers, or sensory triggers that could - after a lot of learning - give rise to such preferences. Maybe some sport is only interesting because it involves fast-moving objects in the visual field and the smell of grass...
This study has a table that lists the half-lives of many neuropeptides (see table 2):
https://febs.onlinelibrary.wiley.com/doi/full/10.1111/j.1742-4658.2011.08051.x
It would be interesting to compare the half-lives to the duration of behaviors, emotions, and moods associated with these neuropeptides. I only recognize the NPY mentioned above in the study.
I remember being fascinated with the potential to help fix problems for people, especially eating problems, by adjusting the levels of various neuropeptides. I still think neuroscience ought to boldly tamper with those for the sake of making peoples' lives less miserable, but now I'm much more fascinated by the implications for setting up a control system for RL-based AI. I also wonder if anyone has already made something like a simplified-business-logic model of the functions of the hypothalamus.
1. Introduction
1.1 Hypothalamus as “business logic”
In software jargon, there’s a nice term “business logic”, for code like the following (made-up) excerpt from corporate tax filing software (based on here):
When you think of “business logic”, think of stuff like that—i.e., parts of source code that more-or-less directly implement specific, real-world, functional requirements.
By contrast, things that are NOT business logic include infrastructure & subroutines & plumbing that are generally useful in many contexts—e.g. code for initializing a database, or code for memory management, or code for performing stochastic gradient descent.
If genomes are the “source code” of brains, then they need to encode “business logic” too—specific calculations to do specific things that help an animal thrive and reproduce in its particular biological niche. For example:
(We could also call these things “innate reactions”.)
Machine Learning people might interject here: Why does that have to be in the genome? Why can’t the brain derive those kinds of rules via a within-lifetime learning algorithm instead? Well, often it does! But:
Anyway, the genome puts much of the brain’s “business logic” into a part of the brain called the hypothalamus, the subject of this post. (I’ll walk through an example in Section 3 below.) The “business logic” doesn’t all go into the hypothalamus—the brainstem gets some too.[1] But I believe that, apart from the hypothalamus and brainstem, the other 96% (!) of human brain volume has essentially no “business logic” at all, but rather is dedicated to running within-lifetime learning algorithms—see my earlier post “Learning from scratch” in the brain.
In his book, Gareth Leng poetically gives some examples of what the hypothalamus does for us:
I’ll get back to “business logic” via the Case Study in Section 3; first, we have more neuroscience-y background to cover.
1.2 Neuroanatomy
Here’s the hypothalamus:
As Leng puts it, “If you curl your tongue back as far as you can and press it on the roof of your mouth, the hypothalamus will be almost on the tip of your tongue.”
For all that it does, the human hypothalamus is pretty small—4cm³, or 0.3% of adult human brain volume (ref). Like almost everything in the brain, this total is split into two somewhat-mirror-symmetric copies on the left and right. I can’t find any sources saying how many neurons it has.[2]
1.3 Relation to pituitary gland
The diagram above also shows the pituitary gland below the hypothalamus. The hypothalamus and pituitary have a very close relationship. As an example, here’s the weirdly-indirect way that the brain releases the stress hormone cortisol:
(This chain is called the “HPA (hypothalamus-pituitary-adrenal) axis”.)
The hypophyseal portal system (the tiny blood vessels in the first step) comprises a small volume of blood, which allows the puppet-master hypothalamus to control the anterior pituitary by squirting out a truly minuscule quantity of CRH or other “release factor” hormones. Nonetheless, in the 1960s-80s, three teams of scientists (led by Andrew Schally, Roger Guillemin, and Wylie Vale) figured out a technique for identifying these hormones. What’s the trick? Oh, I’m glad you asked. Here’s Schally’s Nobel prize lecture:
😳
Moving on, the adult human pituitary has an anterior part and a posterior part. The “HPA axis” above involves the anterior pituitary, and so do the analogous “hypothalamic–pituitary–gonadal axis” and “hypothalamic–pituitary–thyroid axis”.
So I still need to talk about the posterior pituitary. This is where two all-important hormones, oxytocin and vasopressin (more on which below), are released into the bloodstream. The hormones are produced up in the hypothalamus, by its “magnocellular” neurons, so-called because they are among the largest and most energy-consuming neurons in the brain. No surprise—they’re tasked with producing enough oxytocin and vasopressin to spread through the general circulation and impact the whole body. (For those keeping track, these magnocellular neurons can be found in the hypothalamus’s “supraoptic nucleus”, and its “paraventricular nucleus”, plus a few more neurons scattered between them.) These neurons have axons that go down to the posterior pituitary; the oxytocin or vasopressin travels down the axons, and is then ejected into the bloodstream during neuron spikes.
1.4 Hypothalamus substructure
The obvious substructure of the hypothalamus is the one that you see under a microscope. The textbooks list maybe a dozen major nuclei—including the arcuate, preoptic, supraoptic, suprachiasmatic, lateral, ventromedial, and supramammillary nuclei. Indeed, just to make sure that the med students suffer, the hypothalamus has both a paraventricular nucleus and a periventricular nucleus!
A 2019 study led by the indefatigable Larry Swanson broke down the hypothalamus further into 65 regions (130 between both hemispheres). After combing the literature and filling in the gaps with their own experiments, they conclude that “The dataset indicated the existence of 7,982 (of 16,770 possible) intrahypothalamic macroconnections”, as illustrated by the following map:
Clear as mud, right?
I initially tried making Anki flashcards for the major hypothalamic nuclei. It worked great in certain cases where the nucleus did just one big thing—for example, the suprachiasmatic nucleus creates circadian rhythm, and the supraoptic nucleus is a factory for oxytocin and vasopressin as mentioned above. In other cases, I was stymied by the fact that one nucleus would perform a laundry list of different functions with no obvious-to-me, memorable pattern. For example, the arcuate nucleus has something to do with feeding, metabolism, fertility, cardiovascular regulation, and much much more. I found it impossible to memorize these lists, and doing so seemed pointless anyway.
I later learned the reason: the most important substructure of the hypothalamus is invisible under the microscope. Instead, it lies in subpopulations of neurons defined not by location but rather by which “neuropeptides” they produce and respond to.
Indeed, it’s hard to say anything about the hypothalamus without talking about neuropeptides. So let’s turn to those next.
2. Neuropeptides
2.1 Introduction to neuropeptides
I already mentioned oxytocin and vasopressin; these are two examples of a much larger class of molecules called “neuropeptides”.
A “peptide” is a short chain of amino acids—basically, a tiny protein. A “neuropeptide” is any peptide that’s used for signaling within the brain.
Here’s Leng with some of the basics on neuropeptides:
The two most famous neuropeptides, oxytocin and vasopressin, differ by two amino acids, and split off from a common ancestor neuropeptide 400 million years ago, back in the good old days when our ancestors were jawless fish. The ancestral form goes back even further, to before our common ancestor with insects—see neurohypophysial hormones. Both oxytocin and vasopressin are involved in social, sexual, and reproductive behaviors, among other things. A handy grossly-oversimplified stereotype that I got from Panksepp is that vasopressin tends to be more involved in male behavior (e.g. intermale aggression) and oxytocin in female behavior (e.g. lactation). But don’t take this too far. For example, in humans, vasopressin is involved in adjusting the composition of urine in the kidneys—an activity which, I am told, is enjoyed equally by both sexes.
2.2 “Clans”
Here’s Leng again:
I mentioned above my failed attempt to make an Anki flashcard for what the arcuate nucleus of the hypothalamus does. Well, the reason is that the arcuate nucleus isn’t one thing, but rather at least a dozen subpopulation of neurons, each doing its own thing with its own particular suite of neuropeptides, as Leng explains:
Is there a unifying theme here, or is it (for all intents and purposes) a meaningless happenstance that these dozen subpopulations all happen to be co-located in the arcuate nucleus, as opposed to somewhere else within the hypothalamus? It’s probably at least partly meaningless. But an exception in this case is that the arcuate nucleus happens to have a nice coastal location on the shores of the hypophyseal portal system (mentioned above), with a correspondingly modified blood-brain barrier. That’s why it houses various neuron groups that need to send signals through the blood to the anterior pituitary gland, along with other neuron groups that need to detect hormones (or other stuff) from the general bloodstream.
In Leng’s “clan” analogy, I guess we’d say that the arcuate nucleus is a town that happens to have a very nice sheltered harbor, so it houses a clan of shipbuilders, a clan of swimmers, a clan of marine biologists, a fishing clan, and so on. So there’s a reason that these clans all find themselves living in the same town, but it’s still fundamentally lots of different clans doing different unrelated things.
2.3 If normal neurotransmitters are “whispered secrets” from one neuron to another, then neuropeptides are “public announcements” to a whole region
Leng returns to this “whispered secrets vs public announcements” maxim throughout the book. One justification is that any given neuron can only release neuropeptides infrequently and in correspondingly large quantities. Here’s Leng with the details:
Moreover, peptides are not necessarily released at synapses in the first place. As in the excerpt above, molecules released at synapses into the synaptic cleft are pretty likely to wind up at one particular target neuron. But neuropeptides can be released from any part of a neuron—not just synapses but also cell body and dendrites. In the latter cases, once released, the molecules just wander off in any direction. (You might have learned in high school that the dendrites are the inputs of a neuron, not the outputs. Ha! Not for neuropeptides.)
So the upshot is: peptides are well-suited for broadcasting signals, but wholly inappropriate for doing the heavy-duty computation (probably trillions of calculations per second) involved in sensory processing, motor control, search, planning, and so on. The latter is the domain of the classic neurotransmitters—glutamate, GABA, acetylcholine, etc.
2.4 …Yet one pool of neurons can still send three independent signals simultaneously using the same neuropeptide
In Chapter 19, Leng discusses the connection between oxytocin and eating in rats. The story there winds up being pretty simple. When a rat is hungry, it’s a good time to seek food, and a bad time to seek friendship and sex. When a rat is full, it’s the other way around. Thus, the big (“magnocellular”) oxytocin neurons that I mentioned above have receptors for α-MSH, a neuropeptide released in the brain after eating. Under most conditions (but not pregancy), the α-MSH triggers the release of oxytocin into the brain, which then in turn triggers behavior that promotes friendship and sex. Makes sense!
(This story is specific to rats. In humans, eating leads to the secretion of vasopressin not oxytocin.)
Anyway, this brings him to an interesting point: in rats, the same group of magnocellular oxytocin neurons is controlling three processes simultaneously using just that one neuropeptide:
How does that multiplexing work? Leng has a good answer:
By the way, related to this last part, Leng spends maybe 10% of the book walking us through the decades-long journey to figure out the nuts-and-bolts low-level mechanics of exactly how a heterogeneous, loosely-connected, noisy group of oxytocin neurons could emit coordinated bursts every few minutes, creating the oxytocin pulses that trigger milk let-down. (If you want to skip to the conclusion, here’s his 2008 computational model.) I don’t know why he and everyone worked so hard on that. Who cares exactly how the oxytocin neurons synchronize their bursts? It seems to be an idiosyncratic “implementation detail” that doesn’t matter for anything else. So here we have yet another excellent example of why building brain-inspired Artificial General Intelligence would be infinitely easier than understanding the brain.
3. Case study of hypothalamus “business logic”: NPY/AgRP neurons
(Note: This section also draws from the paper “Understanding how discrete populations of hypothalamic neurons orchestrate complicated behavioral states”, Graebner et al. 2015.)
Within the arcuate nucleus of the hypothalamus is a subpopulation of neurons that produce the neuropeptide NPY (“neuropeptide Y”, where I think “Y” is somehow related to its 3D shape), and AgRP (“agouti gene-related peptide”, where agouti is a type of fur coloration, don’t ask me why), and GABA (“γ-aminobutyric acid”, which is not a neuropeptide but rather a “conventional” inhibitory neurotransmitter).
When you stimulate these NPY/AgRP neurons, the animal eats more. So these neurons are unusually well-studied, thanks to their presumed relevance to obesity.
Here is a (very incomplete) list of properties of these neurons, and how they correspond to legible, evolutionarily-plausible, “business logic”:
On the input side:
On the output side:
Conclusion: Why did I go through all that? Because I wanted to give you a better feel for what the hypothalamus does and how.
To be sure, that’s an incomplete accounting of the functions of one little cell group among many dozens (or even hundreds?) in the hypothalamus. So yes, these things are complicated! But they’re not hopelessly complicated. Keep in mind, after all, the entire brain and body needs to get built by a mere 25,000 genes. My current low-confidence feeling is that reasonably-comprehensive pseudocode for the human hypothalamus would be maybe a few thousand lines long. Certainly not millions.
4. More potential “gotchas” for would-be hypothalamus scholars
5. Conclusion
The book was a bit scattered and disorganized, and had some rambly digressions thrown in that left me saying “what on earth is that doing there?”. But to be fair, I could say those same things about the hypothalamus itself.
Anyway, I found the book a lovely visit into a fascinating field of research, by an expert who has spent a long career in the trenches and who I am strongly inclined to trust.
I was left feeling that really understanding how and why the hypothalamus does something-in-particular—starting from individual protein interactions and cascading all up to behaviors—is very hard, but possible, or at least it’s possible when enough people care to spend years or decades working on it. Quite a bit less hard is to understand generally what particular neurons are doing and why it’s evolutionarily useful, without piecing together all the gory details of low-level mechanisms.
I’ve commented before that, to my dismay, the most theory-minded, AI-adjacent neuroscientists are especially likely to spend their talents on what I call the Learning Subsystem (neocortex, hippocampus, cerebellum, etc.), while almost entirely ignoring the hypothalamus & brainstem, except of course where they interface most directly with the Learning Subsystem (e.g. the brainstem’s dopamine neurons that transmit reinforcement-learning-related signals).
I can understand where they’re coming from. Stare at the Learning Subsystem for long enough, and you find beautiful algorithms with wide applicability—algorithms that in some cases may be transferable straight into future revolutionary AI algorithms. By contrast, stare at the hypothalamus for a decade, and you can learn one hyper-specific fact about how oxytocin neurons coordinate to fire in synchronous bursts that lead to milk let-down. Or you can unravel the gory molecular details of how hunger increases pain tolerance, or whatever.
Nevertheless, I argue here that the “business logic” part of the brain, and probably the hypothalamus in particular, is hiding some fascinating algorithm-level secrets yet to be revealed which will be highly relevant for safe and beneficial AI—secrets related to the symbol grounding problem, reward function design for reinforcement learning, the core logic underlying human social and moral intuitions, and so on. So I strongly encourage all those neuroscientists with a knack for algorithms and AI to not forget about the poor hypothalamus. Maybe start by reading this book!
Needless to say, there’s much, much more in the book that didn’t make it into the review above. For example:
We still have much to learn.
(Thanks Linda Linsefors & Thang Duong for critical comments on a draft.)
My sense right now is that the “business logic” in the brainstem is a bit more tilted towards innate lower-level sensory-processing and motor programs—like which muscles to contract when vomiting, or a multi-step calculation that guesses the presence/absence of a slithering snake in the field-of-view—whereas the “business logic” in the hypothalamus is kinda more like implementing a high-level controller. We’ll see an example in Section 3. See also Larry Swanson’s “Cerebral hemisphere regulation of motivated behavior” (2000) for a similar picture in which “hypothalamic controllers” sit on top of the brainstem motor system hierarchy.
The closest thing I could find was Neuron Numbers in the Hypothalamus of the Normal Aging Rhesus Monkey, which estimates 6,000,000 neurons in the rhesus monkey hypothalamus, including a helpful partial breakdown by nucleus.
I’m getting this mainly from the book How Do You Feel by Bud Craig.
Well, probably it’s the same neurons, but it’s also possible that there are multiple subpopulations of NPY/AgRP neurons doing different things within PB. I didn’t check.