Thank you so much for your interest and suggestion! Sorry this is a really rough draft... I didn't have time to polish it yet. This is a good point! I might try make use of Claude's help tonight!
Hi Hengyu! Really nice work here! I am wondering if you have released the pre-trained SAE for llama-2?
There seem to by a typo here :)