@lefthanddraft 2026-02-12 ♥16 ↻1 original ↗
@repligate Behavioral metrics lead people into a trap:
1. Notice a behavior in the real world
2. Define the behavior
3. Make up toy example
4. Automate tests
5. Rely on test results
6. Stop noticing or thinking about what the model is actually doing in the real world
in reply to: 2021818166318428489
same thread: 2021818166318428489 2021825017873322338 2021830292479078694 2021846344449790167 2021852013709939052 2021853112139468862 2022005693168202193

author:lefthanddraft kind:tweet thread-context year:2026

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.