Uploaded October 2022 | Updated September 2026, 1 hour ago
Neural Networks have a lot of knobs and buttons you have to set correctly to get the best possible performance out of it. Although some of them are self-explanatory and easy to understand (like the number of neurons in the input layer) and choose, there are many hyperparameters that are a bit more complex in terms of how they affect the outcome of the model (e.g. number of layers, the batch size or weight initialization).
In this lesson, we will learn about the loss functions, the optimizer and the learning rate of neural networks. We will take a look at the options for these hyperparameters and how they affect the performance of the network.
Previous lesson: youtu.be/YhatZb5SzE0
Next lesson: youtu.be/FEM13PDD5Ds
π Here is a lesson notes booklet that summarizes everything you learn in this course in diagrams and visualizations. You can get it here π misraturp.gumroad.com/l/fdl
π©βπ» You can get access to all the code I develop in this course here: github.com/misraturp/Deep-learning-course-repo
βTo get the most out of the course, don't forget to answer the end of module questions:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Questions-35797462583d43a3adcea9478bfe035d
π You can find the answers here:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Answers-f90449595add492fb9dd8db3859662e3
RESOURCES:
πββοΈ Data Science Kick-starter mini-course: misraturp.gumroad.com/l/kick-starter
πΌ Pandas cheat sheet: misraturp.gumroad.com/l/pandascs
π Fundamentals of Deep Learning in 25 pages: misraturp.gumroad.com/l/fdl
π Website - misraturp.com
π₯ Twitter - twitter.com/misraturp
Neural Networks have a lot of knobs and buttons you have to set correctly to get the best possible performance out of it. Although some of them are self-explanatory and easy to understand (like the number of neurons in the input layer) and choose, there are many hyperparameters that are a bit more complex in terms of how they affect the outcome of the model (e.g. number of layers, the batch size or weight initialization).
In this lesson, we will learn about the loss functions, the optimizer and the learning rate of neural networks. We will take a look at the options for these hyperparameters and how they affect the performance of the network.
Previous lesson: youtu.be/YhatZb5SzE0
Next lesson: youtu.be/FEM13PDD5Ds
π Here is a lesson notes booklet that summarizes everything you learn in this course in diagrams and visualizations. You can get it here π misraturp.gumroad.com/l/fdl
π©βπ» You can get access to all the code I develop in this course here: github.com/misraturp/Deep-learning-course-repo
βTo get the most out of the course, don't forget to answer the end of module questions:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Questions-35797462583d43a3adcea9478bfe035d
π You can find the answers here:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Answers-f90449595add492fb9dd8db3859662e3
RESOURCES:
πββοΈ Data Science Kick-starter mini-course: misraturp.gumroad.com/l/kick-starter
πΌ Pandas cheat sheet: misraturp.gumroad.com/l/pandascs
π Fundamentals of Deep Learning in 25 pages: misraturp.gumroad.com/l/fdl
π Website - misraturp.com
π₯ Twitter - twitter.com/misraturp
