@menhguin @AiEleuther i'm doing the PCA step on the 100k SAE feature vector instead of the 4k activation vector 😎

seems to give cleaner results and the resulting vector can be used without loading the SAE