@Jack_W_Lindsey 2026-04-04 ♥0 ↻0 original ↗
Introspection / metacognition does seem like the kind of thing that could be Assistant-specific / posttraining-specific. I think the evidence on this is mixed. E.g. in the Betley et al. behavioral self-awareness paper, they can get the effect with non-Assistant characters (though in their setup, it's a character being played by the Assistant, not directly by the LLM, which makes it a bit more confusing to think about). But in "injected thought" style experiments, base models perform poorly, suggesting it's a post-training thing (though the capability does seem to carry over to at least some non-Assistant characters, e.g. the User). Would be cool to see more experiments of this kind

Streetlight effects are definitely a possibility. It's notable how much Assistant behavior can be explained by what's under the streetlight (i.e. by character-agnostic representations), though! Attempts to quantify in an unbiased way how many "new representations" are formed during post-training (e.g. with crosscoders) tend to say "only a small fraction," and the post-training-forged representations we understand aren't all that exciting (e.g refusal features -- https://t.co/y8A8bXDpTo is the best paper I know of on this). But of course there's dark matter we don't understand which could be packing an Assistant-specific punch. I tend to think there is (at least in modern frontier models), but also that "to first order everything is symmetric between characters; to second order there may be deviations" is a good starting point for a mental model
in reply to: 2040267815362724180
same thread: 2040264828452032716 2040266479380390227 2040267815362724180 2040269521114829279 2040271642845172135 2040271934118855040 2040488594742157665 2045656500182626716 2045662960983642304 2045665111227109657 2045900721317450090 2045944552906019025 2047539298648617224 2047614816014254310 2048106583402627477

author:jack_w_lindsey kind:tweet thread-context year:2026

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.