that's understandable, it's a long system card. i just spent awhile going back to the system card trying to understand why this experiment wouldn't count as "working on CoT faithfulness" and was very confused how it wouldn't if you had seen it. i agree they could've done more, though it's not clear to me that CoT monitoring is a basket worth filling with quite so many eggs anyways vs. activation monitoring and other techniques, specifically because there are so many ways (even just from pretraining) that it can be unfaithful.
same thread: 2041952176185209310 2041954983239667849 2041957378854416616 2041971613315559777 2041975805245587848 2041978775198691703 2041980260305269071 2041987235084751185 2041988987011920111 2041990464325480518 2041991951105585422 2041993089951396319 2041994557248958467
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.