# @repligate — 2024-09-20

♥96 ↻5 · https://x.com/repligate/status/1837043778953355770

This is really peculiar!Llama 405b Instruct has an epileptiform(?) condition in which it will "glitch" and output highly random sequences of tokens. They're so random that it sometimes outputs special reserved tokens it wasn't trained on in this state. (https://t.co/2JQp6owVTX)… https://t.co/VrKoAR5TLE

tags: author:repligate, kind:tweet, model:llama-3-1-405b-base, on:llama-3-1-405b-base, year:2024
cited on: _dossiers/llama-3-1-405b-base.md, llama-3-1-405b-base