Why neural networks are so deep? (AlexNet - Explained) @CodeEmporium
Why neural networks are so deep? (AlexNet - Explained)  @CodeEmporium
Uploaded August 2025 | Updated November 2026, 3 hours ago
Let's understand how neural networks became so deep and why they needed to be

ABOUT ME
⭕ Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
📚 Medium Blog: medium.com/@dataemporium
💻 Github: github.com/ajhalthor
👔 LinkedIn: linkedin.com/in/ajay-halthor-477974bb

RESOURCES
[1 📚] Slides used in the video: link.excalidraw.com/p/readonly/2LnP0qEyx2S7eZzogLMD
[2 📚] Main paper that introduced AlexNet: proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
[3 📚] Great video that explains lateral inhibition: youtube.com/watch?v=Y4RHUsLKIM0


PLAYLISTS FROM MY CHANNEL
⭕ Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
⭕ Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
⭕ ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
⭕ Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
⭕ The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
⭕ Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
⭕ Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD


MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: imp.i384100.net/MathML
📕 Calculus: imp.i384100.net/Calculus
📕 Statistics for Data Science: imp.i384100.net/AdvancedStatistics
📕 Bayesian Statistics: imp.i384100.net/BayesianStatistics
📕 Linear Algebra: imp.i384100.net/LinearAlgebra
📕 Probability: imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
📕 Python for Everybody: imp.i384100.net/python
📕 MLOps Course: imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): imp.i384100.net/NLP
📕 Machine Learning in Production: imp.i384100.net/MLProduction
📕 Data Science Specialization: imp.i384100.net/DataScience
📕 Tensorflow: imp.i384100.net/Tensorflow

CHAPTERS
00:00 Introduction
00:15 Timeline of neural network research
01:52 Rise of GPUs and how it helped neural networks
02:18 ImageNet and hot it helped computer vision research
02:56 How AlexNet came to be
04:09 AlexNet architecture and training at a high level
05:53 ReLU activation and how to removes vanishing gradients
08:30 Training on multiple GPUs and how it speeds up performance
10:09 Local Response Normalization to mimic lateral inhibition
14:27 Overlapping pooling
15:15 Why do Deep networks overfit?
15:57 Data Augmentation and how it curbs overfitting
17:02 Dropout and how it curbs overfitting
19:32 Putting it all together
20:24 Quiz Time
21:22 Summary
Why neural networks are so deep? (AlexNet - Explained)What are Foundation Models?Forgotten history of Calculus in IndiaSequence to Vector Recurrent Neural Networks  #deeplearning #machinelearningLLM Agents - Explained!Primary Visual Cortex: How brain processes what we seeReceptive Fields - ExplainedChatGPT historyDeconvolution - what do networks learn? (visualization + code)Why Transformers over LSTMs? #deeplearning  #machinelearningWhat is Attention in Transformers? #deeplearning #machinelearningWhat is dynamic convolution neural network
CodeEmporium |

Why neural networks are so deep? (AlexNet - Explained)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER