@voooooogel 2023-09-11 ♥553 ↻80 original ↗
New blog post: making a transformer by hand, without training! Want to understand transformers and attention better? This post goes through assigning each weight for a GPT-2-like transformer to understand how they work. https://t.co/u889HzVVoU
same thread: 1701290467185549729 1701290521124282384

author:voooooogel kind:tweet on:gpt-2 year:2023

cited on: gpt-2

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.