Tokenization and Byte Pair Encoding @SerranoAcademy
Tokenization and Byte Pair Encoding  @SerranoAcademy
Uploaded December 2025 | Updated November 2026, 3 hours ago
LLMs don't process words, they process tokens. What are tokens? They are groups of characters, which break down words in a logical way. In order to train a well performing LLM, good tokenization is essential.
In this video, you'll learn tokenization and one of its most common methods: byte-pair encoding (BPE)

To see the whole LLM course, click here!
https://www.serrano.academy/large-language-models
Tokenization and Byte Pair EncodingJosh Starmer and Luis Serrano Live Q/A from Uphill at Bern! (Moderated by Philip Schläfl)The attention mechanism in higher dimensionsHow Large Language Models are Shaping the FutureSerrano.Academy - The art of understandingWhat is Quantum Machine Learning?Logistic Regression and the Perceptron Algorithm: A friendly introductionThe Beta distribution in 12 minutes!Direct Preference Optimization (DPO) - How to fine-tune LLMs directly without reinforcement learningA friendly introduction to Bayes Theorem and Hidden Markov ModelsKolmogorov-Arnold Networks (KANs) - What are they and how do they work?Mean, Variance, Skewness, and Kurtosis - Math for ML with Deeplearning.ai
Luis Serrano Academy |

Tokenization and Byte Pair Encoding

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER