@jacyanthis @stanislavfort @AISafetyMemes 2. Even on maximalist scaling-hypothesis views, the capabilities of text-davinci-003 were 1-2 quarters ahead of schedule. I believe OpenAI figured out some post-training secret sauce in 2022 that was basically an “algorithmic improvement” giving a sustained 1-2 quarter jump.
in reply to: 1798706772041179389
cited on: text-davinci-002
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.