Watch the idea click: a visual guide to transformers.
A video learning post featuring 3Blue1Brown, with a watch plan, a short exercise, and the creator’s written lesson.
PAUSE.
UNDERSTAND.A lesson worth pressing play on.
Press play. Stay curious.
Your watch-club starting point
Grant Sanderson’s 3Blue1Brown lesson “Transformers, the tech behind LLMs” was published on April 1, 2024. It is an evergreen visual introduction, not breaking news. The video and illustrated companion lesson cover tokens, embeddings, and the broad structure of a transformer.
Watch with a question
Before pressing play, write down what you think a token is. Watch for the distinction between learned model weights and the changing data passing through the network. Pause when the vectors appear and explain, in your own words, what those numbers represent.
A five-minute exercise
Choose a short sentence. Sketch a sequence of tokens, a list of vectors, and a final next-token prediction. Your diagram can be deliberately simple. Label anything you are still unsure about, then use the creator’s written lesson to check your explanation.
Video credit and reading alternative
The embedded video belongs to 3Blue1Brown and is played from the creator’s YouTube upload. It is not a community-owned or CC BY-licensed video. Use the player’s captions where available; the creator’s written companion lesson is linked below for a reading alternative. If embedding is unavailable in your browser, open the original video.
Go to the source
Keep the idea moving.
Have a question, improvement, or your own experiment? Bring it to the repository.
Discuss on GitHubSuggest an edit