Uploaded August 2026 | Updated September 2026, 2 weeks ago

---

This video tells the story of the Transformer, the architecture behind ChatGPT, Gemini, Claude, and much of modern AI. It explains why older language models struggled with long text, how attention changed everything, and why the 2017 paper Attention Is All You Need became such a turning point. You’ll also learn how a small group of Google researchers accidentally helped create the foundation for today’s biggest AI companies.

Video created by @aniakubow

❤️ Support for this channel comes from our friends at Scrimba – the coding platform that's reinvented interactive learning: scrimba.com/freecodecamp

🎉 Thanks to our Champion and Sponsor supporters:
👾 @omerhattapoglu1158
👾 @goddardtan
👾 @akihayashi6629
👾 @kikilogsin
👾 @anthonycampbell2148
👾 @tobymiller7790
👾 @rajibdassharma497
👾 @CloudVirtualizationEnthusiast
👾 @adilsoncarlosvianacarlos
👾 @martinmacchia1564
👾 @ulisesmoralez4160
👾 @_Oscar_
👾 @jedi-or-sith2728
👾 @justinhual1290

--

Learn to code for free and get a developer job: freecodecamp.org

Read hundreds of articles on programming: freecodecamp.org/news