Where did convolution networks come from? @CodeEmporium
Where did convolution networks come from?  @CodeEmporium
Uploaded June 2025 | Updated November 2026, 3 hours ago
Let's take a look at how convolution neural networks evolved diving into an early network called Neo-cognitron. Hopefully, we can answer questions like:
1. Why do we use convolution, activation, pooling?
2. Why do the networks have layered architectures
3. What exactly is being learned in a convolution network

ABOUT ME
β­• Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
πŸ“š Medium Blog: medium.com/@dataemporium
πŸ’» Github: github.com/ajhalthor
πŸ‘” LinkedIn: linkedin.com/in/ajay-halthor-477974bb

RESOURCES
[1 πŸ“š] Slides: link.excalidraw.com/p/readonly/o0yE3HWfPMaBcu9QBPNf
[2 πŸ“š] Main paper for neocognitron: rctn.org/bruno/public/papers/Fukushima1980.pdf
[3 πŸ“š] Great demo (start at 3:12) : youtu.be/KAazjZoiCd0?si=WPNUg4YKBbJtlwsD
[4 πŸ“š] Original Paper from Hubel and Wiesel's experiment: pmc.ncbi.nlm.nih.gov/articles/PMC1363130/pdf/jphysiol01298-0128.pdf


PLAYLISTS FROM MY CHANNEL
β­• Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β­• Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β­• ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β­• Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β­• The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β­• Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β­• Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD


MATH COURSES (7 day free trial)
πŸ“• Mathematics for Machine Learning: imp.i384100.net/MathML
πŸ“• Calculus: imp.i384100.net/Calculus
πŸ“• Statistics for Data Science: imp.i384100.net/AdvancedStatistics
πŸ“• Bayesian Statistics: imp.i384100.net/BayesianStatistics
πŸ“• Linear Algebra: imp.i384100.net/LinearAlgebra
πŸ“• Probability: imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
πŸ“• ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
πŸ“• Python for Everybody: imp.i384100.net/python
πŸ“• MLOps Course: imp.i384100.net/MLOps
πŸ“• Natural Language Processing (NLP): imp.i384100.net/NLP
πŸ“• Machine Learning in Production: imp.i384100.net/MLProduction
πŸ“• Data Science Specialization: imp.i384100.net/DataScience
πŸ“• Tensorflow: imp.i384100.net/Tensorflow

CHAPTERS
00:00 Hubel & Weisel’s Experiment
02:00 Precoursor to CNNs
03:40 Why layered organization?
04:50 Simple Cells in biology
06:40 Simple Cells in computation model (relu activation)
08:56 Primary Visual Cortex in biology
10:28 Primary Visual Cortex in computation model
11:58 Where does β€œconvolution” come in?
15:38 Complex Cells in biology
16:57 Complex Cells in computation model (pooling)
18:04 convolution + activation + pooling
21:15 How does the network learn?
30:22 Conclusion
30:46 Quiz Time
31:40 Summary
Where did convolution networks come from?Knowledge Distillation in Neural Networks - Explained!Why do CNNs look like THIS?Why Do Transformers Look Like This?LoRA - Explained!Decoder training with transformersMasked RCNN - Explained!  #deeplearning #machinelearningBuilding your first Neural NetworkLSTM construction explained #deeplearning #machinelearningHow did Language change Vision Transformers?Machine Learning Paradigms: Supervised and Unsupervised LearningCode for transformer
CodeEmporium |

Where did convolution networks come from?

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER