Welch Labs | Neural Networks Demystified [Part 5: Numerical Gradient Checking] @WelchLabsVideo | Uploaded 9 years ago | Updated 4 hours ago
When building complex systems like neural networks, checking portions of your work can save hours of headache. Here we'll check our gradient computations.
Supporting code:
github.com/stephencwelch/Neural-Networks-Demystified
Link to excellent Stanford tutorial: http://ufldl.stanford.edu/wiki/index.php/UFLDL_Tutorial
In this series, we will build and train a complete Artificial Neural Network in python. New videos every other friday.
Part 1: Data + Architecture
Part 2: Forward Propagation
Part 3: Gradient Descent
Part 4: Backpropagation
Part 5: Numerical Gradient Checking
Part 6: Training
Part 7: Overfitting, Testing, and Regularization
@stephencwelch
When building complex systems like neural networks, checking portions of your work can save hours of headache. Here we'll check our gradient computations.
Supporting code:
github.com/stephencwelch/Neural-Networks-Demystified
Link to excellent Stanford tutorial: http://ufldl.stanford.edu/wiki/index.php/UFLDL_Tutorial
In this series, we will build and train a complete Artificial Neural Network in python. New videos every other friday.
Part 1: Data + Architecture
Part 2: Forward Propagation
Part 3: Gradient Descent
Part 4: Backpropagation
Part 5: Numerical Gradient Checking
Part 6: Training
Part 7: Overfitting, Testing, and Regularization
@stephencwelch
![Neural Networks Demystified [Part 5: Numerical Gradient Checking]](https://i.ytimg.com/vi/pHMzNW8Agq4/hqdefault.jpg "Neural Networks Demystified [Part 5: Numerical Gradient Checking]
When building complex systems like neural networks, checking portions of your work can save hours of headache. Here well check our gradient computations.
Supporting code:
https://github.com/stephencwelch/Neural-Networks-Demystified
Link to excellent Stanford tutorial: http://ufldl.stanford.edu/wiki/index.php/UFLDL_Tutorial
In this series, we will build and train a complete Artificial Neural Network in python. New videos every other friday.
Part 1: Data + Architecture
Part 2: Forward Propagation
Part 3: Gradient Descent
Part 4: Backpropagation
Part 5: Numerical Gradient Checking
Part 6: Training
Part 7: Overfitting, Testing, and Regularization
@stephencwelch")
![Imaginary Numbers Are Real [Part 10: Complex Functions]](https://i.ytimg.com/vi/pNp8Qf20-sA/hqdefault.jpg "Imaginary Numbers Are Real [Part 10: Complex Functions]
Supporting Code: https://github.com/stephencwelch/Imaginary-Numbers-Are-Real
More information and resources: http://www.welchlabs.com
Imaginary numbers are not some wild invention, they are the deep and natural result of extending our number system. Imaginary numbers are all about the discovery of numbers existing not in one dimension along the number line, but in full two dimensional space. Accepting this not only gives us more rich and complete mathematics, but also unlocks a ridiculous amount of very real, very tangible problems in science and engineering.
Part 1: Introduction
Part 2: A Little History
Part 3: Cardans Problem
Part 4: Bombellis Solution
Part 5: Numbers are Two Dimensional
Part 6: The Complex Plane
Part 7: Complex Multiplication
Part 8: Math Wizardry
Part 9: Closure
Part 10: Complex Functions
Part 11: Wandering in Four Dimensions
Part 12: Riemanns Solution
Part 13: Riemann Surfaces
Want to learn more or teach this series? Check out the Imaginary Numbers are Real Workbook: http://www.welchlabs.com/resources.")
![How to Science [Part 5: Mathematics]](https://i.ytimg.com/vi/sTSNTWKGkbw/hqdefault.jpg "How to Science [Part 5: Mathematics]
pdf: http://www.welchlabs.com/guides
support welch labs:
https://www.patreon.com/welchlabs
music:
https://www.premiumbeat.com/royalty-free-tracks/jazz-manouche-forever
https://www.premiumbeat.com/royalty-free-tracks/out-of-the-wood
shttps://www.premiumbeat.com/royalty-free-tracks/among-the-hills")
![Learning to See [Part 4: Machine Learning]](https://i.ytimg.com/vi/sarVw-iVWgc/hqdefault.jpg "Learning to See [Part 4: Machine Learning]
In this series, well explore the complex landscape of machine learning and artificial intelligence through one example from the field of computer vision: using a decision tree to count the number of fingers in an image. Its gonna be crazy.
Supporting Code: https://github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs")
![Learning To See [Part 14: Better Heuristics]](https://i.ytimg.com/vi/tPHImr2sFBM/hqdefault.jpg "Learning To See [Part 14: Better Heuristics]
In this series, well explore the complex landscape of machine learning and artificial intelligence through one example from the field of computer vision: using a decision tree to count the number of fingers in an image. Its gonna be crazy.
Supporting Code: https://github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs")
