@repligate 2025-06-17 ♥1 ↻0 original ↗
I’ve also seen this kind of thing, and I think it’s a bit absurd to think that internalizing a fictional reality that is so relevant to its model of its situation would not have more general effects on its psychology. Or that a mitigation as they did would cleanly undo effects. Behaviors like that in llms tend not to be localized and affect the world model. Emergent misalignment stuff supports this point.

I think my use of the word “imprinting” was justified. They didn’t expect the data would have such an influence. It had such an influence they had to try to undo it. This means it was more salient than they accounted for.

(And indeed I’ve found that the imprinting and later maybe behavioralist mitigation very likely has more general effects on Claude Opus 4’s psychology that I think Anthropic would think of as detrimental effects)
same thread: 1934396816424071464 1934397160222822568 1934397792778342676 1934397962186334551 1934398304361627952 1934398740884009430 1934400208227717513 1934401357597007965 1934406122183479694 1934406606529409233 1934410625557712971 1934411369547522197 1934411943131128246 1934421868104290408 1934422194253443374 1934422792608555365 1934423497167749521 1934424405930889523 1934424893958844577 1934427410742886820

author:repligate kind:tweet model:claude-opus-4 thread-context year:2025

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.