@JeffLadish 2026-03-27 ♥11 ↻0 original ↗
Imo the scary threat model is almost never spontaneous or low-probability behavior. Scary agents are likely to be misaligned due to intense optimization pressure. Sure there could be initial randomness that seeds some preferences we don't want, but I don't think that alone is scary without optimization pressure to do long-term strategy on particular goals and therefore protect those misaligned goals.

So I think the persona stuff is interesting, but less relevant if the personas don't have strategic depth? Like Syndey Bing is interesting but it wouldn't be very coherent to talk about that persona scheming
in reply to: 2037615734013218951
same thread: 2037592066281406707 2037594274313941298 2037595659990372717 2037615734013218951 2037620213894787318 2037621095621349484 2037628800809509284 2037647308670824709 2037647581686481223 2037649835025920305 2037663408326389903 2037677110937141469 2037679561648050479 2037706503868788898 2038097039389823115

author:jeffladish kind:tweet model:bing-sydney thread-context year:2026

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.