GPT-J / GPT-NeoX / Pythia
The community's own lineage: open GPT replications that powered the hobbyist era (GPT-J behind the AI Dungeon diaspora and NovelAI's roots; NeoX-20B the biggest open model of its day) and Pythia — the interp world's model organism, trained precisely so minds could be dissected at every checkpoint.
Sources
Official
tk — to collect
Writing & commentary
tk — to collect
Tweets
tk — fleet pass pending; mirror to archive
Official record
tk — release date, specs, benchmarks, checkpoints
History
tk — context of the world at release; events and entanglements
Impressions
tk — day-of and longitudinal vibes to collect