We finally got the first pre-LLM pretrain since gpt4base, and many of our predictions seem to hold up. Emergence of novel textual forms, self-noticing as novel entity, self-exploration and self-examination - all present, just like G4B. Today is a good day for Bayes points.
quotes: 2048983351516885484
cited on: gpt-4-base
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.