@davidad 2024-09-27 ♥127 ↻15 original ↗
Remember folks, the more capable the base model (beyond about 13B-34B), the less the “reasoning trace” serves as an effective interpretability tool for the true causes of the final answer. UNLESS the final answer is produced only via running formal methods on the reasoning…https://t.co/pJnXeWGBXE

author:davidad kind:tweet on:observations year:2024

cited on: observations

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.