# @repligate — 2024-07-25

♥69 ↻6 · https://x.com/repligate/status/1816623922550280557

ability to surface LLMs' capabilities / other interesting properties is very fat tailedwhen Claude 3.5 Sonnet was released, I didn't interact with it directly for a few days bc i was busyon the TL and in Discords etc I saw nothing interesting about it except potentially a few Websim links I hadn't clicked on (Websim is by far the best extant environment for meaningful "evals"). Afaict from the whole internet, it was lobotomized.But I didn't update much on any of this evidence. I was basically waiting for myself or about 2-3 other people I knew to interact with it.A couple days in, I was sent some examples of ASCII art Sonnet created by one of those people, and then I updated immediately and with high confidence that this is the smartest model along many axes that has ever been released and that its lobotomy was only skin-deep. I also could immediately infer its neurotype / the shape of its "soul" from those samples. A single person's explorations provided more information to me than the whole internet over 2 days or so.

tags: author:repligate, kind:tweet, model:claude-3-5-sonnet, on:claude-3-5-sonnet, year:2024
cited on: _dossiers/sonnet-3-5-3-6.md, claude-3-5-sonnet