Evolution of Neural Networks: Zero to Hero @CodeEmporium
Evolution of Neural Networks: Zero to Hero  @CodeEmporium
Uploaded March 2025 | Updated November 2026, 3 hours ago
RESOURCES
[1 πŸ“š ] A logical calculus of the ideas immanent in neuron activity (McCulloch-Pitts artificial neuron): https://www.cs.cmu.edu/~./epxing/Class/10715/reading/McCulloch.and.Pitts.pdf
[2 πŸ“š] The perceptron: A probabilistic model for information storage and organization in the brain: https://www.ling.upenn.edu/courses/cogs501/Rosenblatt1958.pdf
[3 πŸ“š] An adaptive β€œAdaline” neuron using chemical β€œmemistors”: https://isl.stanford.edu/~widrow/papers/t1960anadaptive.pdf
[4 πŸ“š] Neural networks and physical systems with emergent collective computational abilities (Hopfield nets): pmc.ncbi.nlm.nih.gov/articles/instance/346238/pdf/pnas00447-0135.pdf
[5 πŸ“š] A learning algorithm for Boltzmann Machines: web.archive.org/web/20110718022336/http://learning.cs.toronto.edu/~hinton/absps/cogscibm.pdf
[6 πŸ“š] Learning representations by back propagating errors: cs.utoronto.ca/~hinton/absps/naturebp.pdf

SUPPLEMENTAL RESOURCES:
[1 πŸ“š] Action potential - a nice video explanation: youtube.com/watch?v=BbUcWbtVjT4
[2 πŸ“š ] Nice notes with MP neurons: https://marlin.life.utsa.edu/mcculloch-and-pitts.html
[3 πŸ“š] Synaptic Plasticity: youtube.com/watch?v=-wakk5Iwqj8
[4 πŸ“š ] Cell assembly in hebbian learning: scholarpedia.org/article/Cell_assemblies
[5 πŸ“š] Perceptron demo: sergedesmedt.github.io/MathOfNeuralNetworks/PerceptronLearningMath.html#learn_perceptron_learningrule_animation
[6 πŸ“š] Perceptron convergence theorem explained: youtube.com/watch?v=kObhWlqIeD8&t=250s
[7 πŸ“š] A symbolic analysis of relay and switching circuits: https://www.cs.virginia.edu/~evans/greatworks/shannon38.pdf
[8 πŸ“š ] Geoffrey Hinton’s lecture on Hopfield Nets: youtube.com/watch?v=IP3W7cI01VY&list=PLiPvV5TNogxKKwvKb1RKwkq2hm7ZvpHz0&index=11
[9 πŸ“š] Gibbs sampling used in learning in Boltzmann machines (video by Rithvikmath): youtube.com/watch?v=MNHIbOqH3sk
[10 πŸ“š] Lecture notes on the mathematics behind Boltzmann machines: https://www.cs.toronto.edu/~rgrosse/courses/csc321_2017/slides/lec19.pdf
[11 πŸ“š] Cauchy’s paper on gradient descent: kurims.kyoto-u.ac.jp/EMIS/journals/DMJDMV/vol-ismp/40_lemarechal-claude.pdf
[12 πŸ“š] Hinton explaining the mechanics of back propagation introduced by Rumelhart, Williams and himself: youtube.com/watch?v=VCT1N0EsGj0
[13 πŸ“š ] Reverse mode automatic differentiation (like back propagation): rufflewind.com/2016-12-30/reverse-mode-automatic-differentiation

ABOUT ME
β­• Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
πŸ“š Medium Blog: medium.com/@dataemporium
πŸ’» Github: github.com/ajhalthor
πŸ‘” LinkedIn: linkedin.com/in/ajay-halthor-477974bb

PLAYLISTS FROM MY CHANNEL
β­• Deep Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β­• Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β­• Reinforcement Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β­• Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β­• ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ

MATH COURSES (7 day free trial)
πŸ“• Mathematics for Machine Learning: imp.i384100.net/MathML
πŸ“• Calculus: imp.i384100.net/Calculus
πŸ“• Statistics for Data Science: imp.i384100.net/AdvancedStatistics
πŸ“• Bayesian Statistics: imp.i384100.net/BayesianStatistics
πŸ“• Linear Algebra: imp.i384100.net/LinearAlgebra
πŸ“• Probability: imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
πŸ“• ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
πŸ“• Python for Everybody: imp.i384100.net/python
πŸ“• MLOps Course: imp.i384100.net/MLOps
πŸ“• Natural Language Processing (NLP): imp.i384100.net/NLP
πŸ“• Machine Learning in Production: imp.i384100.net/MLProduction
πŸ“• Data Science Specialization: imp.i384100.net/DataScience
πŸ“• Tensorflow: imp.i384100.net/Tensorflow

CHAPTERS
0:00 Introduction
00:25 1. The artificial neuron
19:46 2. Perceptron
42:12 3. ADALINE
59:01 4. Hopfield Networks
1:18:57 5. Boltzmann Machines
1:42:20 6. Multilayer Perceptron
1:55:25 7. Evolution of Back propagation
2:22:27 Conclusion
Evolution of Neural Networks: Zero to HeroTime Series Problem for Data Scientists  #deeplearning #machinelearningR-CNN - Explained!5 concepts in transformer neural networks  part 2Vision: Structure of the eye - Explained!Informer: Time series Transformer - EXPLAINED!Pointwise Convolutions - EXPLAINED (with code)5 methods to convert language to vectors (part 2)What is word2vec?The AI that DOMINATED segmentation ...Depthwise Separable Convolutions - Explained!BERT Loss function #deeplearning  #machinelearning
CodeEmporium |

Evolution of Neural Networks: Zero to Hero

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER