@CognitiveTech_ eleuther published a library for training saes but afaik nobody has trained one on a whole model yet. until that happens i think cvecs are the better option for regular people, similar effect
in reply to: 1807962695003476440
cited on: eleutherai
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.