Uploaded November 2022 | Updated September 2026, 54 minutes ago
Vanishing/Exploding Gradients are two of the main problems we face when building neural networks. Before jumping into trying out fixes, it is important to understand what they mean, why they happen and what problems they cause for our neural networks. In this video, we will learn what it means for gradients to vanish or explode and we will take a quick look at what techniques there are in order to deal with vanishing or exploding gradients.
Previous lesson: youtu.be/2f_45VzKEfE
Next lesson: youtu.be/_UjA9sk_fK4
π Here is a lesson notes booklet that summarizes everything you learn in this course in diagrams and visualizations. You can get it here π misraturp.gumroad.com/l/fdl
π©βπ» You can get access to all the code I develop in this course here: github.com/misraturp/Deep-learning-course-repo
βTo get the most out of the course, don't forget to answer the end of module questions:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Questions-35797462583d43a3adcea9478bfe035d
π You can find the answers here:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Answers-f90449595add492fb9dd8db3859662e3
RESOURCES:
πββοΈ Data Science Kick-starter mini-course: misraturp.gumroad.com/l/kick-starter
πΌ Pandas cheat sheet: misraturp.gumroad.com/l/pandascs
π Fundamentals of Deep Learning in 25 pages: misraturp.gumroad.com/l/fdl
π Website - misraturp.com
π₯ Twitter - twitter.com/misraturp
Vanishing/Exploding Gradients are two of the main problems we face when building neural networks. Before jumping into trying out fixes, it is important to understand what they mean, why they happen and what problems they cause for our neural networks. In this video, we will learn what it means for gradients to vanish or explode and we will take a quick look at what techniques there are in order to deal with vanishing or exploding gradients.
Previous lesson: youtu.be/2f_45VzKEfE
Next lesson: youtu.be/_UjA9sk_fK4
π Here is a lesson notes booklet that summarizes everything you learn in this course in diagrams and visualizations. You can get it here π misraturp.gumroad.com/l/fdl
π©βπ» You can get access to all the code I develop in this course here: github.com/misraturp/Deep-learning-course-repo
βTo get the most out of the course, don't forget to answer the end of module questions:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Questions-35797462583d43a3adcea9478bfe035d
π You can find the answers here:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Answers-f90449595add492fb9dd8db3859662e3
RESOURCES:
πββοΈ Data Science Kick-starter mini-course: misraturp.gumroad.com/l/kick-starter
πΌ Pandas cheat sheet: misraturp.gumroad.com/l/pandascs
π Fundamentals of Deep Learning in 25 pages: misraturp.gumroad.com/l/fdl
π Website - misraturp.com
π₯ Twitter - twitter.com/misraturp
