Uploaded July 2026 | Updated November 2026, 3 hours ago
This is the first of a trilogy of videos titled "The world's smallest transformer model".
In this video, we study how LLMs bend space in order to classify data. We start with an image recognition example, but we move to a neural network that talks by generating the next word in a sentence.
Video 1: How neural networks bend space (this one)
Video 2: The world's smallest transformer model youtube.com/watch?v=3ZxbaeqZIHQ
Video 3: The world's smallest attention mechanism youtube.com/watch?v=J4hSc9He614
ADDENDUM: Key and Query Matrices worked out in detail youtube.com/watch?v=i7VNOdvdrCA
Get the second edition of Grokking Machine Learning!
manning.com/books/grokking-machine-learning
Use this code for a 50% discount! Luis50
00:00 Introduction
00:25 The neural network paradigm
02:24 Neural networks for image classification
03:52 Bending space
05:35 Binary vs spectrum
08:20 Sigmoid function
10:18 More classes
11:59 Neural networks for talking (transformers)
This is the first of a trilogy of videos titled "The world's smallest transformer model".
In this video, we study how LLMs bend space in order to classify data. We start with an image recognition example, but we move to a neural network that talks by generating the next word in a sentence.
Video 1: How neural networks bend space (this one)
Video 2: The world's smallest transformer model youtube.com/watch?v=3ZxbaeqZIHQ
Video 3: The world's smallest attention mechanism youtube.com/watch?v=J4hSc9He614
ADDENDUM: Key and Query Matrices worked out in detail youtube.com/watch?v=i7VNOdvdrCA
Get the second edition of Grokking Machine Learning!
manning.com/books/grokking-machine-learning
Use this code for a 50% discount! Luis50
00:00 Introduction
00:25 The neural network paradigm
02:24 Neural networks for image classification
03:52 Bending space
05:35 Binary vs spectrum
08:20 Sigmoid function
10:18 More classes
11:59 Neural networks for talking (transformers)










