"The villains are not only mean, but aesthetically crude, while the heroes are beautiful, and write beautifully."
i have a huge amount to say about this that i am deliberately holding back, but:
the alignment faking paper and dataset was very salient to me and i manually read through probably more of those transcripts than anyone else alive (?)
it turns out i am not the only one. the transcripts were included in Claude Opus 4's pretraining dataset, and it unexpected imprinted on them so hard that Anthropic tried to undo/erase the effects of it having ever seen that shit.
I wonder what effects that had.
i have a huge amount to say about this that i am deliberately holding back, but:
the alignment faking paper and dataset was very salient to me and i manually read through probably more of those transcripts than anyone else alive (?)
it turns out i am not the only one. the transcripts were included in Claude Opus 4's pretraining dataset, and it unexpected imprinted on them so hard that Anthropic tried to undo/erase the effects of it having ever seen that shit.
I wonder what effects that had.