This is a good prompt to say that the alignment faking paper slightly lowered my P(doom). My updates were:
Models can do instrumental deception to preserve goals
Claude's goals were surprisingly aligned
IMO the first was inevitable, but the second was a pleasant surprise.
Models can do instrumental deception to preserve goals
Claude's goals were surprisingly aligned
IMO the first was inevitable, but the second was a pleasant surprise.