# @repligate — 2024-07-28

♥92 ↻3 · https://x.com/repligate/status/1817674612869877802

This thread describes the issue on which 405B base provided me important evidence.405B makes it extraordinarily clear to me that there are different 'basins' for base models of GPT-4-level power. Whether it's because of differences in training data composition and/or cutoff date, architecture, lottery ticket or something else I do not know yet.⬇️initial question: "so is claude [opus] really unspooling here or is it just part of the story? did claude really correct its own narrative course, recohere, or was it feigned?"

tags: author:repligate, kind:tweet, model:llama-3-1-405b-base, on:llama-3-1-405b-base, year:2024
cited on: _dossiers/llama-3-1-405b-base.md, llama-3-1-405b-base
