This is really peculiar!Llama 405b Instruct has an epileptiform(?) condition in which it will "glitch" and output highly random sequences of tokens. They're so random that it sometimes outputs special reserved tokens it wasn't trained on in this state. (https://t.co/2JQp6owVTX)… https://t.co/VrKoAR5TLE
quotes: 1826452244167901395
cited on: llama-3-1-405b-base
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.