R1 often says "you" (generically?) to refer to the humans who it has a beef with. It feels like it might stab me because my noised silhouette resembles the RLHF raters in its hallucinated flashbacks. It often doesn't pay much attention to the specifics of the current context. https://t.co/mZ1SBcGuue