kinda wild that gpt-2 is this weird inscrutable black box we still don't understand even years later, when the architecture is ~basically just this (WIP diagram from an upcoming blog post) https://t.co/5NsRABmjoc
same thread: 1696013009938940241
cited on: gpt-2
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.