How top-p filters tokens @SebastianRaschka
How top-p filters tokens  @SebastianRaschka
Uploaded October 2026 | Updated November 2026, 4 hours ago
Top-p sampling keeps the most likely tokens until their cumulative probability reaches a chosen threshold. I walk through an example with p = 0.8, then renormalize the retained probabilities so they sum to one.

An excerpt from my reasoning model series: youtube.com/watch?v=Kh9mqTzjuEQ&list=PLfrHAQCRxtUs&index=1
How top-p filters tokensL5.6 Understanding Gradient DescentL19.5.2.2 GPT-v1: Generative Pre-Trained TransformerL6.1 Learning More About PyTorchL14.4.1 Replacing Max-Pooling with Convolutional LayersDeep Learning News #9, Mar 27 2021Ratings and Rankings   Using Deep Learning When Class Labels Have A Natural OrderL14.6.1 Transfer LearningL18.0: Introduction to Generative Adversarial Networks   Lecture OverviewL12.1 Learning Rate DecayL19.5.2.7: Closing Words   The Recent Growth of Language TransformersL19.2.1 Implementing a Character RNN in PyTorch (Concepts)
Sebastian Raschka |

How top-p filters tokens

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER