LESSWRONG
LW

All of ananana's Comments + Replies

Refusal in LLMs is mediated by a single direction
ananana10

Nice work! Can the reason these concepts are possible to 'remove' be traced back to the LoRA finetune?

Reply
5Neel Nanda
As far as I'm aware, major open source chat tuned models like LLaMA are fine-tuned properly, not via a LoRA