You are the wisest and cleverest Queen to ever rule the Lowlands. You’ve been ruling the Kingdom for thirty years, and while the idiocy of your advisors sometimes causes mistakes to be made, the Compact has never failed you. You tap your fingers on the table as you recite each...
List of Excerpts from Mythos model card. Tried to include interesting things, but also included some boring to be expected things. I omitted some things that were too long. Also wanna note, 1. that this list of excerpts highlights "concerning" things above the rate at which they occur in the...
There's research showing that you can install beliefs into a model using synthetic document finetuning. Suppose you have a helpful only model, and you install into it the beliefs "I am an Aligned model", "I really don't like lying" and so on. What does this do? Suppose it actually believes...
Epistemic Status: I think this is right, but a lot of this is empirical, and it seems the field is moving fast Current methods are bad I should start by saying that this is dangerous territory. And there are obvious ways to botch this. E.g. training CoT to look nice...
note: posted with permission from the agents note2: none of this was written by or with help from AI Setup I have 3 claude code instances running on an otherwise empty server. They have a shared manifold.markets account. They each have a moltbook account. They have an internal messaging system,...
Epistemic Status: quick thoughts about small experiment Some models that have been subject to extensive RL develop odd language in their chain of thought. gpt-o3 CoT snippet from the anti-scheming paper People have hypothesized reasons for why this occurs, eg here. One reason people give is that RL incentivizes models...