Previous: AI Safety Interventions TL;DR: I made an overview of the open problems of AI alignment that reveals cruxes within those open problems and missed opportunities for formalization and collaboration. And CEV may deserve a second look. Epistemic status: Trying too much in too little time. I'm confident I have...
Palisade Research: > We demonstrate that language models can autonomously replicate their weights and harness across a network by exploiting vulnerable hosts. The agent independently finds and exploits a web-application vulnerability, extracts credentials, and deploys an inference server with a copy of its harness and prompt on the compromised host....
This is a full repost of my Hidden Agent Substack post. LLM disclaimer: The post has been written with ChatGPT 5.2 assistance and some paragraphs may still show that even though I have written most of the post myself. The image is generated by NanoBanana. Adam Smith’s Invisible Hand is...
Companion to "The Hostile Telepaths Problem" (by Valentine) Epistemic status: This is my own work, though I asked Valentine for feedback on an early draft. I'm confident that the mechanisms underlying the Hostile/Friendly Telepath dynamic are closely related. The problems of the friendly telepath problems seem well-established. I am less...
Epistemic status: Confident in the direction, not confident in the numbers. I have spent a few hours looking into this. Suppose human values were internally coherent, high-dimensional, explicit, and decently stable under reflection. Would alignment be easier or harder? My below calculations show that it would be much harder, if...
Epistemic status: I’m using a single clinical case study as a running example to illustrate three empirical aspects of cognition that are well-documented but rarely used together. The point is not that this case study proves anything, but to build an intuition that I then connect to more systematic empirical...
finding agents in raw dynamics Related: Formalizing «Boundaries» with Markov blankets, «Boundaries» Sequence The Dataset Suppose you are given time series data from a simulated ecology (such as Smallville). You can usually tell what the agents in there are doing; at least if the variables are properly labeled. If they...