Uploaded February 2020 | Updated September 2026, 3 days ago
slides: mlvu.github.io/lectures/41.DeepLearning1.annotated.pdf
course materials: mlvu.github.io
We recap the basic algorithm of (scalar) backpropagation from last lecture and we discuss in detail what is required to extend this into a mature automatic differentiation system: how to deal with any computation graph, and how to apply backpropagation to models that operate in terms of tensor operations (like matrix multiplication).
The explanation broadly follows the structure of PyTorch, but most concepts apply to Tensorflow and other deep learning frameworks too.
slides: mlvu.github.io/lectures/41.DeepLearning1.annotated.pdf
course materials: mlvu.github.io
We recap the basic algorithm of (scalar) backpropagation from last lecture and we discuss in detail what is required to extend this into a mature automatic differentiation system: how to deal with any computation graph, and how to apply backpropagation to models that operate in terms of tensor operations (like matrix multiplication).
The explanation broadly follows the structure of PyTorch, but most concepts apply to Tensorflow and other deep learning frameworks too.










