+1 to Neel. We just fixed a release bug and now pip install transformer-lens should install 1.16.0 (worked in a colab for me)
6Neel Nanda
It was added recently and just added to a new release, so pip install transformer_lens should work now/soon (you want v1.16.0 I think), otherwise you can install from the Github repo
1Andy Arditi
A good incentive to add Llama 3 to TL ;)
We run our experiments directly using PyTorch hooks on HuggingFace models. The linked demo is implemented using TL for simplicity and clarity.
transformer_lens doesn't seem to be updated for Llama 3? Was trying to replicate Llama 3 results, would be grateful for any pointers. Thanks