How to Select the Right Activation Function and Batch Size @misraturp
How to Select the Right Activation Function and Batch Size  @misraturp
Uploaded October 2022 | Updated September 2026, 40 minutes ago
Neural Networks have a lot of knobs and buttons you have to set correctly to get the best possible performance out of it. Although some of them are self-explanatory and easy to understand (like the number of neurons in the input layer) and choose, there are many hyperparameters that are a bit more complex in terms of how they affect the outcome of the model (e.g. number of layers, the batch size or weight initialization).

In this lesson, we will learn about the activation function, the batch size and the number of epochs. We will take a look at the options for these hyperparameters and how they affect the performance of the network.

Previous lesson: youtu.be/KI5gOnlQeN8
Next lesson: youtu.be/4GGHaBpTV9w

πŸ“™ Here is a lesson notes booklet that summarizes everything you learn in this course in diagrams and visualizations. You can get it here πŸ‘‰ misraturp.gumroad.com/l/fdl

πŸ‘©β€πŸ’» You can get access to all the code I develop in this course here: github.com/misraturp/Deep-learning-course-repo

❓To get the most out of the course, don't forget to answer the end of module questions:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Questions-35797462583d43a3adcea9478bfe035d

πŸ‘‰ You can find the answers here:
https://fishy-dessert-4fc.notion.site/Deep-Learning-101-Answers-f90449595add492fb9dd8db3859662e3

RESOURCES:
πŸƒβ€β™€οΈ Data Science Kick-starter mini-course: misraturp.gumroad.com/l/kick-starter
🐼 Pandas cheat sheet: misraturp.gumroad.com/l/pandascs
πŸ“™ Fundamentals of Deep Learning in 25 pages: misraturp.gumroad.com/l/fdl

🌎 Website - misraturp.com
πŸ₯ Twitter - twitter.com/misraturp
How to Select the Right Activation Function and Batch SizeWhat to learn to become a data scientistTraining a Network for Better PerformanceGradient Clipping and How it Helps with Exploding Gradients in Neural NetworksQuick explanation: One-hot encodingEpisode 3 - Being a technical writer at a big tech firm with Melissa BarrPart 2: Best Settings to Initialize Your NN withKey Concepts and Techniques for Natural Language ProcessingThe only explanation you need for bias and variance in Data ScienceIt only takes 2 minutes to master your tasklist. Productivity tips from @DataProfessorEpisode 12 - Life as a PhD student working working on AI with Selene BΓ‘ez SantamarΓ­aEpisode 4 - A senior data scientists life with Samantha Zeitlin
MΔ±sra Turp |

How to Select the Right Activation Function and Batch Size

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER