Better version of the Twitter thread. Thanks to Fabian Schimpf and Charbel-Raphaël Segerie for feedback. Towards Monosemanticity: Decomposing Language Models With Dictionary Learning Neurons in transformers are not interpretable by themselves. Neural networks want to represent more features than they have neurons