L12.1 Learning Rate Decay @SebastianRaschka
L12.1 Learning Rate Decay  @SebastianRaschka
Uploaded March 2021 | Updated November 2026, 4 hours ago
Sebastian's books: sebastianraschka.com/books

Slides: sebastianraschka.com/pdf/lecture-notes/stat453ss21/L12_optim__slides.pdf

Link to the code referenced in this video:
- github.com/rasbt/stat453-deep-learning-ss21/blob/main/L12/code/batchsize-64.ipynb
- github.com/rasbt/stat453-deep-learning-ss21/blob/main/L12/code/batchsize-1024.ipynb

-------

This video is part of my Introduction of Deep Learning course.

Next video: youtu.be/tB1rz4L93JA

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/dl-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
L12.1 Learning Rate DecayL19.5.2.7: Closing Words   The Recent Growth of Language TransformersL19.2.1 Implementing a Character RNN in PyTorch (Concepts)L13.8 What a CNN Can SeeUnderstanding PyTorch BuffersL14.3.1.2 VGG16 in PyTorch   Code ExampleL9.5.1 Cats & Dogs and Custom Data LoadersL11.5 Weight Initialization   Why Do We Care?L11.6 Xavier Glorot and Kaiming He Initialization13.4.1 Recursive Feature Elimination (L13: Feature Selection)L14.2: Spatial Dropout and BatchNormL15.6 RNNs for Classification: A Many-to-One Word RNN
Sebastian Raschka |

L12.1 Learning Rate Decay

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER