This is a special post for quick takes by shawnghu. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Is anyone else noticing that Claude (Sonnet 3.5 new, the default on claude.ai) is a lot worse at reasoning recently? In the past five days or so its rate of completely elementary reasoning mistakes, which persist despite repeated clarification in different ways, seems to have skyrocketed for me.
Maybe they are preparing for switching from merely encouraging their main model to do CoT (old technique) to a full RL-based reasoning model. I recently saw this, before the GUI aborted and said the model was over capacity:
Then it wouldn't make sense anymore to have the non-reasoning model attempt to do CoT.
I have also seen this.