If I did, I wouldn't publicly say so.
It's of course not yes or no, but just a probability, but in case it's high I might not want to state it here, so I should generally not state it here, so you cannot infer it is high by the fact that I didn't state it here.
I can say though that I only turned 22y last week and I expect my future self to grow up to become much more competent than I am now.
A couple notes based on our previous conversations (mainly the non-written conversation):
(I'm kinda confused why your post here doesn't mention that much; I guess implicitly the evidence about hunting defeats the otherwise fairly [strong according to you] evidence from brain size?)
I suggest that a bias you had was "not looking hard enough for defeaters". But IDK, not at all confident, just a suggestion.
I mentioned that there should be much more impressive behavior if they were that smart...
A counterargument is that it takes culture to build cumulative knowledge to build wealth to create cognitive tools that work well enough to do obviously impressive things. And 50,000 individuals distributed globally isn't enough to build that culture.
That's also a reason that the overall plan isn't so promising, as I mentioned here: https://www.lesswrong.com/posts/vKM4CTjz5fPB7vznb/an-alternative-approach-to-superbabies?commentId=D36FJKkbD7FbLLGG2
2. I mentioned that there should be much more impressive behavior if they were that smart; I don't recall us talking about that much, not sure.
You said "why don't they e.g. jump in prime numbers to communicate they are smart?" and i was like "hunter gatherer's don't know prime numbers and perhaps not even addition" and you were like "fair".
I mean I thought about what I'd expect to see, but I unfortunately didn't really imagine them as smart but just as having a lot of potential but being totally untrained.
3. I recommended that you try hard to invent hypotheses that would explain away the brain sizes.
(I'm kinda confused why your post here doesn't mention that much; I guess implicitly the evidence about hunting defeats the otherwise fairly [strong according to you] evidence from brain size?)
I suggest that a bias you had was "not looking hard enough for defeaters". But IDK, not at all confident, just a suggestion.
Yeah the first two points in the post are just very strong evidence that overpower my priors (where by priors i mean considerations from evolution and brain size, as opposed to behavior). Ryan's point changed my priors, but I think it isn't related enough to "Can I explain away their cortical neuron count?" that asking myself this question even harder would've helped.
Maybe I made a general mistake like "not looking hard enough for defeaters", but it's not that actionable yet. I did try to take all the available evidence and update properly on everything. But maybe some motivated stopping on not trying even longer to come up with a concrete example of what I'd have expected to see from orcas. It's easier to say in retrospect though. Back then I didn't know in what direction I might be biased.
But I guess I should vigilantly look out for warning signs like "not wanting to bother to think about something very carefully" or so. But it doesn't feel like I was making the mistake, even though I probably did, so I guess the sensation might be hard to catch at my current level.
I did try to take all the available evidence and update properly on everything. But maybe some motivated stopping on not trying even longer to come up with a concrete example of what I'd have expected to see from orcas.
These sound good, and maybe you have in mind the same thing I mean, but to clarify, I mean like: Do biased thinking in both directions. I.e. be a lawyer for each side in turn. (Don't only do this of course, also do other things like neutral integration / comparison etc.)
So like, you get your model / argument that says orcas are smart (or that this is a good project). Then you put on the anti hat, and try really hard to find counterarguments--e.g. by thinking of them, and also by motivatedly looking for information that would give a counterargument.
To do this properly you may have to unblend from your wanting X to be true.
TLDR: I now think it’s <1% likely that average orcas are >=+6std intelligent.
I suggest explaining in the TLDR what do you mean by ">=+6std intelligent". +6std with respect to what intelligence? Human intelligence!? If so, please provide more context, as this sounds quite unlikely.
Yes human intelligence.
I forgot to paste in that it's a follow up to my previous posts. Will do now.
Congratulations on changing your mind!
It’s sorta suspicious that I only realized those now, after I officially dropped the project
You should try dropping your other idea and seeing if you come up with reasons that one is wrong too! And/or pick this one up again, then come up with reasons it's a good idea after all. In the spirit of "You can't know if something is a good idea until you resolve to do it"!
In general, I wish this year? (*checks* huh, only 4 months.) of planning this project had involved more empiricism. For example, you could've just checked whether a language model trained on ocean sounds can say what the animals are talking about.
In general, I wish this year? (*checks* huh, only 4 months.)
Nah I didn't loose that much time. I already quit the project end of January, I just wrote the post now. Most of the technical work was also pretty useful for understanding language, which is a useful angle on agent foundations. I had previously expected working on that angle to be 80% as effective as my previous best plan, but it was even better, around similarly good I think. That was like 5-5.5 weeks and that was not wasted.
I guess I spent like 4.5 weeks overall on learning about orcas (including first seeing whether I might be able to decode their language and thinking about how and also coming up with the whole "teach language" idea), and like 3 weeks on orga stuff for trying to make the experiment happen.
Cetaceans like orcas cannot sleep too deeply or else they will drown. They sleep half their brain at a time. Newborn orcas and dolphins don't sleep for the first month of their life.
I suspect that cetaceans have had to dramatically lower their learning rate in order to survive on limited sleep and as a result they have only mediocre intelligence despite their huge brains.
Maybe one thing to expect to see, is for a pod of orcas to reason from first principles that humans underestimate their intelligence. They might then realize they might avoid starvation by proving to humans they were intelligent, by doing a performance or something.
Sometimes humans save wild orcas, so it's not unreasonable to expect this, at least for starving orca pods. The fact we've never seen this is a bad sign. They made no very coordinated attempts to communicate with us.
That said, there still may be a small chance of big implications. Maybe they appear unintelligent just like uncontacted tribespeople would appear unintelligent (especially if they had no hands). They might have slightly higher potential to learn things than humans, and have slight advantages somewhere, and that might still mean a lot.
Proving their intelligence to who? Who would even care? How likely is it that any coordinated action would be taken to save starving orcas? If its highly likely, is this fact legible to them?
It might seem to them that however many intelligent animals we've aided, we might just have harmed as many (intentionally or otherwise), or more.
Have humans ever taken large scale coordinated action to help an animal population that wasn't redressing some harm done to them by humans?
Suppose you lived together with 10 family members in the wilderness. As you explore the world and hunt for food, you observe large shiny objects floating by above you, with mysterious little creatures standing on them looking down on you.
You've heard stories about these strange creatures. Your grandmother says that she was once trapped in a mudslide and thought she would die, but one of the shiny objects landed near her, and the creatures slowly dug her out. But she heard that another family far away was once attacked by these strange creatures, and most of them died.
Now suppose one year, there is no food anywhere, and you and your family start to starve to death. You see the mysterious shiny objects drift by overhead. What do you do?
It seems hard to believe that superintelligent orcas will reliably deduce, with 100% consistency, that the most reasonable action here is to completely ignore these shiny objects as you starve to death.
Maybe if AGI timelines were still > 100 years following this idea might have some merit, but we don't have enough time left for ideas that would need multiple decades to see positive results, especially given that it's unlikely we would get that many von Neumann/einstein-tier biological intelligence for research
I agree these biological intelligence directions are not that promising, but the world is big enough that even far shot ideas are worth a little bit exploration.
I think "How to Make Superbabies" is maybe a few times more promising than using orcas, but also maybe a few times more costly to evaluate.
Follow up to: My previous posts on orca intelligence.
TLDR: I now think it’s <1% likely that average orcas are >=+6std intelligent.
(I now think the relevant question is rather whether orcas might be >=+4std intelligent, since that might be enough for superhuman wisdom and thinking techniques to accumulate through generations, but I think it’s only 2% probable. (Still decently likely that they are near human level smart though.))
1. Insight: Think about societies instead of individuals
I previously thought of +7std orcas like having +7std potential but growing up in a hunter-gatherer-like environment where the potential isn’t significantly realized and they don’t end up that good at abstract reasoning. I imagined them as being untrained and not knowing much. I still think that a +7std human who grew up in a hunter-gatherer society wouldn’t be all that awesome at learning math and science as an adult (though maybe still decently good).
But I think that’s the wrong way to think about orcas. If the average orca was +6std intelligent, it would be a +6std society, where cultural evolution would happen on ultrasteroids, knowledge and skill accumulates quickly and gets taught effectively, so orcas would end up extremely competent. I think the equilibrium for +6std societies is very likely that they act sorta like a macroagent pursuing the multi-agent optimum, aka sorta like dath ilan[1], even if they don’t have science or a growing economy. The amount of expertise that can be transmitted by smart people is pretty large even without writing.
When I realized that, I stopped thinking about “what would I expect to see if there existed +7std orca individuals” (where I implicitly imagined +0std societies) and shifted to thinking “what would I expect to see from small +6std societies without writing and science”, where in my opinion, the latter implies an extremely much higher level of competence, though I’m probably bad at communicating why.
I previously thought that it’s not clear that orcas could catch more prey if they were smarter. (I was mistaken as I realized today, but that’s for later.) Now I stopped thinking just about food but also about other dimensions, and I remembered that the SRKWs (southern resident killer whales) are a reasonably small and reasonably closed population. I asked claude whether they have low genetic variance and yes they seem to have. Thus, this a divergence from the multi-agent optimum: They ought to interbreed more with other populations. Individual +7std orcas couldn’t realistically figure out why low interbreeding with other populations would be bad, but +6std societies totally should I think.[2]
They also ought to be able to demonstrate their intelligence to humans, though it’s plausible that they judge this as undesirable and therefore don’t, but it’s still evidence.
More generally, thinking in terms of +6std societies made me think that somehow I would expect to see something more impressive from wild orcas, even though it’s hard to say what exactly. But they don’t appear to be that smart.
Similar things are true for +4std orcas, thought to a lesser extent. I also don’t expect orcas to be +4std.
2. Evidence: Northern resident orcas seem better at catching some fish species than southern resident orcas
Basically, I checked today why SRKWs (souther resident killer whales) mostly eat chinook salmon, and the reason seems to be that they are not that good at catching other fish/salmon. The SRKWs are somewhat undernourished. NRKWs still eat a lot of chinook, but also a lot of chum salmon and some more fish species.
Claude also mentioned that other salmon species, like chum, in the SRKW territory are less depleted than chinook, and that research suggests that it might help the SRKW food situation if the SRKWs could adapt their hunting strategies to also better catch other fish. (Some salmon species may just be harder to catch, but it at least seems probable that NRKWs are better at catching chum salmon.)
Thus it seems likely that SRKWs could capture more fish if they could execute the techniques of the NRKWs.
It's possible that habitat factors make catching other fish easier in northern territory[3], and that they cannot go into the northern territories and learn from the NRKWs how to catch fish there because the northern orcas don't want them there because that would be additional competition for catching fish. though this itself sorta seems like suboptimal coordination.
Though my main guess is that better techniques would at least help slightly.
This would imply:
(Tbc, this is still in the range of stupidity of humans. orcas could still be human level smart or maybe +1std on average, but it seems significant evidence against them being significantly smarter.)
3. Ryan Greenblatt’s Fermi Estimate
Shortly after I had the two updates above, Ryan Greenblatt posted his Fermi Estimate, which also updated me a bit further.
How could I have thought that faster?
It’s sorta suspicious that I only realized those now, after I officially dropped the project[5]. It suggests I might’ve been biased towards thinking orcas are very smart, but I don’t quite see concretely how I was. I now started training my introspection, and will train myself to notice when my thoughts seem less than maximally truth seeking and have some other motivations attached to them. But during the project I wasn’t good enough to notice any such directionality, and I don’t know yet what to tell my past self so it would actually do better generally in this way, rather than just benefitting from hindsight.
(I still need to plan how to train myself to not make similar mistakes in the future (e.g. thinking through multiple example scenarios of how failure and success might look like), but I will do that early April.)
Implications for the orca language project
I guess don’t bother doing this for x-risk reduction.
It’s still plausible to me that teaching orcas language would work, though it might take a lot longer than if they had been super smart. But it would be interesting. The experiment I proposed still would be interesting in order to test how feasible that might be.
To clarify, they don’t end up there because of altruism, it's because they set up institutions and contracts so you end up at the pareto frontier, even if everyone is selfish. E.g. in the prisoner's dilemma, two selfish parties still have it in their own interest to sign a contract like "i will cooperate if and only if the other person also signs this contract". You might of course need institutions for what happens when the contract is broken. Orcas could invent their own decentralized crypto currency and contracts that when an orca breaches a contract a significant amount of money will be transferred to the orcas who were damaged. Or sth like that.
Aka, I don't think computers and being able to do molecular biology experiments are that important for figuring out interbreeding. Nor writing if you have a decent memory. Yeah humans are bad at deriving correct theories without overwhelming experimental evidence, though even some humans like Einstein were able to.
From claude:
1. Foraging behaviors and techniques NRKWs have been observed using different hunting strategies than SRKWs in some contexts. For example, when Fraser River salmon migrate, NRKWs often intercept them in more northern waters where the salmon are more concentrated in narrower channels. This allows for more efficient hunting compared to the more dispersed salmon populations in the broader Salish Sea where SRKWs typically hunt.
2. Habitat differences NRKWs range extends further north along the British Columbia coast into waters with different bathymetry (underwater topography). These areas include more narrow channels, inlets, and passages that may facilitate certain hunting techniques like corralling fish against shorelines or into bays.
Though not sure about that one. It’s possible the northern orcas just act rationally and have nothing to gain from teaching the southern orcas even if they trade fairly, because perhaps both populations indirectly feed upon the same fish populations.
Not super suspicious, since I already quit at the end of January and postponed writing the post until now, and since I find my other research more exciting anyway, but still. I think maybe I just got better at noticing when sth isn’t actually an equilibrium, and the second insight perhaps followed because I started imagining something actually smart. But still pretty suspicious.