L6.2 Understanding Automatic Differentiation via Computation Graphs @SebastianRaschka
L6.2 Understanding Automatic Differentiation via Computation Graphs  @SebastianRaschka
Uploaded February 2021 | Updated September 2026, 2 weeks ago
Sebastian's books: sebastianraschka.com/books

As previously mentioned, PyTorch can compute gradients automatically for us. In order to do that, it tracks computations via a computation graph, and then when it is time to compute the gradient, it moves backward along the computation graph. Actually, computations graphs are also a helpful concept for learning how differentiation (computing partial derivatives and gradients) work, which is what we are doing in this video.

Slides: sebastianraschka.com/pdf/lecture-notes/stat453ss21/L06_pytorch_slides.pdf

-------

This video is part of my Introduction of Deep Learning course.

Next video: youtu.be/VvUz0Q9e09g

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/dl-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
L6.2 Understanding Automatic Differentiation via Computation GraphsL17.3 The Log-Var TrickL15.0: Introduction to Recurrent Neural Networks   Lecture OverviewL10.2 Data Augmentation in PyTorchL14.3.2.1 ResNet OverviewBuilding LLMs from the Ground Up: A 3-hour Coding WorkshopThe Big LLM Architecture ComparisonInsights from Finetuning LLMs with Low-Rank AdaptationL14.5 Convolutional Instead of Fully Connected LayersL13.4 Convolutional Filters and Weight-SharingDeep Learning News #10, Apr 3 2021L17.6 A Variational Autoencoder for Face Images in PyTorch   Code Example
Sebastian Raschka |

L6.2 Understanding Automatic Differentiation via Computation Graphs

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER