@voooooogel what kinds of pressures are known to, in fact, worsen the faithfulness of the CoT? the obvious one would be punishing models for reasoning about reward hacking while still reinforcing reward hacking. are there others?
in reply to: 2041952176185209310
same thread: 2041952176185209310 2041954983239667849 2041957378854416616 2041971613315559777 2041975805245587848 2041978775198691703 2041980260305269071 2041988267982385348 2041988987011920111 2041990464325480518 2041991951105585422 2041993089951396319 2041994557248958467
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.