LESSWRONG
is fundraising!
Tags
LW
$

Superposition

EditHistorySubscribe

Help improve this page

EditHistorySubscribe

Help improve this page

Contributors

Posts about the concept of superposition - that is, neural nets representing concepts as a superposition of many neurons.

Posts tagged Superposition

8

149[Interim research report] Taking features out of superposition with sparse autoencoders

Lee Sharkey, Dan Braun, beren

2y

23

2

203Toward A Mathematical Framework for Computation in Superposition

Dmitry Vaintrob, jake_mendel, Kaarel

1y

18

2

127Circuits in Superposition: Compressing many small neural networks into one

Lucius Bushnaq, jake_mendel

2mo

8

2

64Superposition is not "just" neuron polysemanticity

8mo

4

2

46Some costs of superposition

Linda Linsefors

10mo

11

2

22AI alignment as a translation problem

11mo

2

2

8From Conceptual Spaces to Quantum Concepts: Formalising and Learning Structured Conceptual Models

10mo

1

1

288Towards Monosemanticity: Decomposing Language Models With Dictionary Learning

Zac Hatfield-Dodds

1y

22

Review

1

137Comparing Anthropic's Dictionary Learning to Ours

1y

8

1

102Open Source Sparse Autoencoders for all Residual Stream Layers of GPT2-Small

11mo

37

1

89Growth and Form in a Toy Model of Superposition

Liam Carroll, Edmund Lau

1y

7

1

74Interpretability with Sparse Autoencoders (Colab exercises)

CallumMcDougall

1y

9

1

69Toy Models of Superposition

2y

4

1

53Paper: Superposition, Memorization, and Double Descent (Anthropic)

2y

11

1

45Some open-source dictionaries and dictionary learning infrastructure

1y

7