KL Divergence - How to tell how different two distributions are @SerranoAcademy
KL Divergence - How to tell how different two distributions are  @SerranoAcademy
Uploaded June 2024 | Updated November 2026, 18 hours ago
Correction (10:26). The probabilities are wrong. The correct ones are here:
For Die 1: 0.4^4 * 0.2^2 * 0.1^1 * 0.1^1 * 0.2^2
For Die 2: 0.4^4 * 0.1^2 * 0.2^1 * 0.2^1 * 0.1^2
For Die 3: 0.1^4 * 0.2^2 * 0.4^1 * 0.2^1 * 0.1^2

Kullback Leibler (KL) divergence is a way to measure how far apart two distributions are.
In this video, we learn KL-divergence in a simple way, using a probability game with dice.

Shannon entropy and information gain: youtube.com/watch?v=9r7FIXEAGvs&t=1066s&pp=ygUic2hhbm5vbiBlbnRyb3B5IGluZm9ybWF0aW9uIHRoZW9yeQ%3D%3D

Grokking Machine Learning book: manning.com/books/grokking-machine-learning
40% discount code: serranoyt
KL Divergence - How to tell how different two distributions areThe Gini Impurity Index explained in 8 minutes!After AI, whats next for humans? - The pyramid of human evolutionHow to stay relevant in AIThe Stone-Weierstrass Theorem - How to approximate functionsWhat is the closest rational approximation to pi?Linear Regression: A friendly introductionUniversal Approximation Theorem - The Fundamental Building Block of Deep LearningLive with Jay Alammar, Josh Starmer, and Luis SerranoAgents, RAG, and Reasoning ModelsQuantum superposition and the glove that changes colorWhy Do We Divide by n−1 to estimate the variance? Bessel’s Correction, Visually Explained #math
Luis Serrano Academy |

KL Divergence - How to tell how different two distributions are

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER