
Andrej Karpathy
@karpathy · Jan 17, 2023
🔥 New (1h56m) video lecture: "Let's build GPT: from scratch, in code, spelled out."
youtube.com/watch?v=kCc8Fm…
We build and train a Transformer following the "Attention Is All You Need" paper in the language modeling setting and end up with the core of nanoGPT.

Elon Musk
@elonmusk
Great thread
05:35 PM · January 17, 2023 · 2.6M views
229
238
6.4K