
Already know some of this? A 2-minute test skips the lessons you know.
Take the placement testA free 2-lesson course built from Andrej Karpathy's 1h 56m of YouTube video. 2 days at 90 minutes a day, with study notes and a quiz in every lesson. A 2-minute placement test skips what you already know.
Taught by Andrej Karpathy on YouTube. Videos play in YouTube's own player, so the creator keeps every view.
Understand the goal of building a small Transformer language model from scratch on the Tiny Shakespeare dataset to demystify how ChatGPT works under the hood.
Load the Tiny Shakespeare text, build a character-level tokenizer (encode/decode), convert the full dataset to a tensor of integers, and split 90/10 into training and validation sets.