L8.4 Logits and Cross Entropy @SebastianRaschka
L8.4 Logits and Cross Entropy  @SebastianRaschka
Uploaded February 2021 | Updated September 2026, 2 weeks ago
Sebastian's books: sebastianraschka.com/books

In the context of deep learning, you will often stumble upon terms such as "logits" and "cross entropy". As we will see in this video, these are not new concepts but are something that we can derive from our understanding of logistic regression. In fact, the logits are what we are already computing in logistic regression. And the cross entropy is essentially equivalent to the logistic regression loss function -- you can think of it as just another name.

Slides: sebastianraschka.com/pdf/lecture-notes/stat453ss21/L08_logistic__slides.pdf

-------

This video is part of my Introduction of Deep Learning course.

Next video: youtu.be/6igMArA6k3A

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/dl-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
L8.4 Logits and Cross EntropyManaging Sources of Randomness When Training Deep Neural NetworksL16.3 Convolutional Autoencoders & Transposed ConvolutionsLLMs: A Journey Through Time and ArchitectureL6.0 Automatic Differentiation in PyTorch   Lecture OverviewL9.0 Multilayer Perceptrons   Lecture OverviewL11.1  Input NormalizationL15.5 Long Short-Term MemoryDeveloping an LLM: Building, Training, FinetuningL6.5 A Closer Look at the PyTorch APIL10.5.4 Dropout in PyTorchL15.1: Different Methods for Working With Text Data
Sebastian Raschka |

L8.4 Logits and Cross Entropy

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER