Uploaded February 2022 | Updated November 2026, 4 hours ago
Sebastian's books: sebastianraschka.com/books
Deep learning offers state-of-the-art results for classifying images and text. Common deep learning architectures and training procedures focus on predicting unordered categories, such as recognizing a positive and negative sentiment from written text or indicating whether images contain cats, dogs, or airplanes. However, in many real-world problems, we deal with prediction problems where the target variable has an intrinsic ordering. For example, think of customer ratings (e.g., 1 to 5 stars) or medical diagnoses (e.g., disease severity labels such as none, mild, moderate, and severe). This talk will describe the core concepts behind working with ordered class labels, so-called ordinal data. We will cover hands-on PyTorch examples showing how to take existing deep learning architectures for classification and outfit them with loss functions better suited for ordinal data while only making minimal changes to the core architecture.
Slides: sebastianraschka.com/pdf/slides/2022-02_rework-coral-lightning.pdf
Code: raschka-research-group.github.io/coral-pytorch
0:00 Introduction
0:32 Many Real-World Predictions Problems Have Ordered Labels
0:57 Ordered Labels? Tell Me More!
3:59 Can't we just use regular classifiers for ordered labels?
5:47 How? Let's (Re)Use What We Already know: An Extended Binary Classification Framework
8:07 Problem: rank inconsistency
10:53 Converting a Classifier into a CORN Model in 3 Lines of Code
13:09 Acknowledgements
Sebastian's books: sebastianraschka.com/books
Deep learning offers state-of-the-art results for classifying images and text. Common deep learning architectures and training procedures focus on predicting unordered categories, such as recognizing a positive and negative sentiment from written text or indicating whether images contain cats, dogs, or airplanes. However, in many real-world problems, we deal with prediction problems where the target variable has an intrinsic ordering. For example, think of customer ratings (e.g., 1 to 5 stars) or medical diagnoses (e.g., disease severity labels such as none, mild, moderate, and severe). This talk will describe the core concepts behind working with ordered class labels, so-called ordinal data. We will cover hands-on PyTorch examples showing how to take existing deep learning architectures for classification and outfit them with loss functions better suited for ordinal data while only making minimal changes to the core architecture.
Slides: sebastianraschka.com/pdf/slides/2022-02_rework-coral-lightning.pdf
Code: raschka-research-group.github.io/coral-pytorch
0:00 Introduction
0:32 Many Real-World Predictions Problems Have Ordered Labels
0:57 Ordered Labels? Tell Me More!
3:59 Can't we just use regular classifiers for ordered labels?
5:47 How? Let's (Re)Use What We Already know: An Extended Binary Classification Framework
8:07 Problem: rank inconsistency
10:53 Converting a Classifier into a CORN Model in 3 Lines of Code
13:09 Acknowledgements










![L11.6 Xavier Glorot and Kaiming He Initialization
Sebastians books: https://sebastianraschka.com/books/I
MPORTANT NOTE: In the video, I talk about the number of input units in the denominator (fan in), but to be correct, it should have been number of input units for both the current and the next layer (fan in + fan out).
Slides: https://sebastianraschka.com/pdf/lecture-notes/stat453ss21/L11_norm-and-init slides.pdf
Papers:
Xavier Glorot and Yoshua Bengio. Understanding the difficulty of training deep feedforward neural networks. Proceedings of the thirteenth international conference on artificial intelligence and statistics. 2010. http://proceedings.mlr.press/v9/glorot10a/glorot10a.pdf?hc_location=ufi]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE international conference on computer vision, pp. 1026-1034. 2015. https://arxiv.org/abs/1502.01852
This video is part of my Introduction of Deep Learning course.
Next video: https://youtu.be/nA6oEAE9IVc
The complete playlist: https://www.youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51
A handy overview page with links to the materials: https://sebastianraschka.com/blog/2021/dl-course.html
If you want to be notified about future videos, please consider subscribing to my channel: https://youtube.com/c/SebastianRaschka L11.6 Xavier Glorot and Kaiming He Initialization](https://i.ytimg.com/vi/ScWTYHQra5E/mqdefault.jpg)