I fully agree. Roughly, this threshold should be when any single number has more than 10²⁴ ALU operations, or 10²⁷ logic gates, in its entire causal history.GPT-3, AlphaFold 2, Stable Diffusion, LLaMa, Dromedary: below the line.GPT-4, PaLM 2, Claude-Next: over the line. https://t.co/AShdLXCHju
cited on: claude-1 · llama-1 · palm
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.