@voooooogel 2024-05-24 ♥0 ↻0 original ↗
@karan4d not exactly, similar but different
- both are activation steering (inference time interventions)
- anthropic uses a pretrained SAE--they trained a big feature discovery model once
- control vectors are trained ad-hoc
same thread: 1794120286130131024 1794120468490060105 1794145147711783040 1794145544371425443 1794149148473618432 1794149381546877078 1794151700863074501 1794151742541885631 1794152030346551475 1794154430755209347

author:voooooogel kind:tweet thread-context year:2024

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.