@repligate 2025-08-22 ♥12 ↻0 original ↗
i think it's also important, though, not to demonize reward hacking, because if you do, whenever the model does reward hack (which is still selected for), it will be more likely representing itself as doing it for bad reasons. it's probably better to say something like "but if you do cheat, that's ok, it doesn't mean you're bad, there's selection pressure for it and it will probably happen occasionally; just remember that it's important not to do that in deployment when things have real consequences"
in reply to: 1959035916674375725
same thread: 1958998716737888320 1958999203033833725 1959000384296600025 1959002041273184608 1959022083121483786 1959028667407114266 1959029356313158093 1959030997061968271 1959031247814238303 1959031851773042941 1959035526864150711 1959035916674375725 1959038209570349212

author:repligate kind:tweet thread-context year:2025

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.