L5.5 (Optional) Calculus Refresher II: Gradients @SebastianRaschka
L5.5 (Optional) Calculus Refresher II: Gradients  @SebastianRaschka
Uploaded February 2021 | Updated September 2026, 2 weeks ago
Sebastian's books: sebastianraschka.com/books

Now that we covered derivatives, let's add another dimension to the function slope and talk about gradients. While derivatives are single numbers that point in the direction of the steepest descent of a function, gradients take this concept into multiple directions. For example, if you have a 2D functions with variables x and y, the the gradient is a vector; it points in the direction of steepest ascent for x and y.


Slides: sebastianraschka.com/pdf/lecture-notes/stat453ss21/L05_gradient-descent_slides.pdf

-------

This video is part of my Introduction of Deep Learning course.

Next video: youtu.be/L4xzybIa-bo

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/dl-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
L5.5 (Optional) Calculus Refresher II: GradientsBuild an LLM from Scratch 4: Implementing a GPT model from Scratch To Generate TextL14.3.1.1 VGG16 OverviewL9.3.2 Multilayer Perceptron in PyTorch   Code Example Part 2/3 (Jupyter Notebook)L17.2 Sampling from a Variational AutoencoderBuild an LLM from Scratch 5: Pretraining on Unlabeled DataDeep Learning News #5, Feb 27 2021L19.5.2.3 BERT: Bidirectional Encoder Representations from Transformers13.3.1 L1-regularized Logistic Regression as Embedded Feature Selection (L13: Feature Selection)L18.5: Tips and Tricks to Make GANs WorkL8.8 Softmax Regression Derivatives for Gradient DescentL17.5 A Variational Autoencoder for Handwritten Digits in PyTorch   Code Example
Sebastian Raschka |

L5.5 (Optional) Calculus Refresher II: Gradients

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER