L5.4 (Optional) Calculus Refresher I: Derivatives @SebastianRaschka
L5.4 (Optional) Calculus Refresher I: Derivatives  @SebastianRaschka
Uploaded February 2021 | Updated September 2026, 2 weeks ago
Sebastian's books: sebastianraschka.com/books

Understanding gradient descent, which is an optimization algorithm for minimizing the loss of a predictive model, requires some calculus basics. Since we all have varying calculus backgrounds, let me introduce or recap some calculus tidbits that will be useful for understanding gradient descent. In this video, I will start by talking about derivatives (you can think of them as something like 1-dimensional gradients).

Slides: sebastianraschka.com/pdf/lecture-notes/stat453ss21/L05_gradient-descent_slides.pdf

-------

This video is part of my Introduction of Deep Learning course.

Next video: youtu.be/YPZVGSRmjLk

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/dl-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
L5.4 (Optional) Calculus Refresher I: DerivativesL19.2.2 Implementing a Character RNN in PyTorch  Code ExampleHow Claudes Text Watermarking WorksDesigning Generative Adversarial Networks for Privacy-enhanced Face Recognition (Conference rec.)L2.3 The Origins of Deep LearningL19.5.1 The Transformer ArchitectureL11.4 Why BatchNorm WorksL10.4 L2 Regularization for Neural NetsL13.9.2 Saving and Loading Models in PyTorchReinforcement Learning with Human Feedback (RLHF) in 4 minutesL19.5.2.5 GPT-v3: Language Models are Few-Shot LearnersL13.5 Whats The Difference Between Cross-Correlation And Convolution?
Sebastian Raschka |

L5.4 (Optional) Calculus Refresher I: Derivatives

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER