Uploaded February 2025 | Updated November 2026, 2 hours ago
Let's understand the architecture that led to John Hopfield's noble prize.
RESOURCES
[1 π] Main paper: pmc.ncbi.nlm.nih.gov/articles/instance/346238/pdf/pnas00447-0135.pdf
[2 π] Geoffrey Hintonβs lecture on Hopfiled Nets: youtube.com/watch?v=IP3W7cI01VY&list=PLiPvV5TNogxKKwvKb1RKwkq2hm7ZvpHz0&index=11
[3 π] Why physical systems minimize total energy: physics.stackexchange.com/questions/255353/why-does-a-system-try-to-minimize-its-total-energy
[4 π] Entropy: youtube.com/watch?v=DxL2HoqLbyA
[5 π] Lecture notes on applications of Hopfield networks: https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=e97b368e1d9e68a930bd6efb822ab0a8980e95a4
[6 π] Paper that proved the memory capacity of hopfield nets is 0.14N: https://www.physics.rutgers.edu/~morozov/568_s2020/Physics_568_2020_files/Amit_Sompolinsky_PhysRevLett1985.pdf
[7 π] Historical notes in the end seemed useful: https://axon.cs.byu.edu/~martinez/classes/678/Papers/Hopfield_Chapter.pdf
[8 π] Hopfield and Lex talking about associative memory: youtube.com/watch?v=aDHWbgEufYU
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
CHAPTERS
0:00 Why Hopfield Networks?
2:18 How humans store and recall memories
4:05 How Hopfield network is organized
5:34 How Hopfield network stores memory?
7:37 How Hopfield network recalls memory?
16:00 Energy landscape
16:31 Pros and Cons of Hopfield networks
18:42 Quiz Time
19:43 Summary
Let's understand the architecture that led to John Hopfield's noble prize.
RESOURCES
[1 π] Main paper: pmc.ncbi.nlm.nih.gov/articles/instance/346238/pdf/pnas00447-0135.pdf
[2 π] Geoffrey Hintonβs lecture on Hopfiled Nets: youtube.com/watch?v=IP3W7cI01VY&list=PLiPvV5TNogxKKwvKb1RKwkq2hm7ZvpHz0&index=11
[3 π] Why physical systems minimize total energy: physics.stackexchange.com/questions/255353/why-does-a-system-try-to-minimize-its-total-energy
[4 π] Entropy: youtube.com/watch?v=DxL2HoqLbyA
[5 π] Lecture notes on applications of Hopfield networks: https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=e97b368e1d9e68a930bd6efb822ab0a8980e95a4
[6 π] Paper that proved the memory capacity of hopfield nets is 0.14N: https://www.physics.rutgers.edu/~morozov/568_s2020/Physics_568_2020_files/Amit_Sompolinsky_PhysRevLett1985.pdf
[7 π] Historical notes in the end seemed useful: https://axon.cs.byu.edu/~martinez/classes/678/Papers/Hopfield_Chapter.pdf
[8 π] Hopfield and Lex talking about associative memory: youtube.com/watch?v=aDHWbgEufYU
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
CHAPTERS
0:00 Why Hopfield Networks?
2:18 How humans store and recall memories
4:05 How Hopfield network is organized
5:34 How Hopfield network stores memory?
7:37 How Hopfield network recalls memory?
16:00 Energy landscape
16:31 Pros and Cons of Hopfield networks
18:42 Quiz Time
19:43 Summary

![Faster R-CNN - Explained!
In this video, we take a look the Faster RCNN network. What is it? Why and how is it faster than the other R-CNN networks?
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides used in the video: https://link.excalidraw.com/p/readonly/7vHOtVwF88DWBwEbKgeW
[2 π] Main paper of the video:https://arxiv.org/pdf/1506.01497
[3 π] RCNN video: https://youtu.be/ZytVRaNE4cA?si=jnBfm_vuh_9wwZau
[4 π ] Fast RCNN video: https://youtu.be/rYLD9RLCqGo?si=qFzm35uGulhXwoja
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is Faster R-CNN?
00:37 Why Faster R-CNN?
03:47 Region Proposal Network (RPN)
05:14 Why does RPN look like that?
14:05 Training Faster R-CNN
24:00 Inference of Faster R-CNN
26:21 Quiz Time
27:21 Summary Faster R-CNN - Explained!](https://i.ytimg.com/vi/ws0nlxCWWI8/mqdefault.jpg)



![THIS changed Segmentation FOREVER!
What if DETR predicted Masks instead of Boxes? There is a story behind this. We are going to talk about the MaskFormer and Mask2Former and how that changed segmentation.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Transformer Paper: https://arxiv.org/pdf/1706.03762
[2 π] DETR paper: https://arxiv.org/pdf/2005.12872
[3 π] MaskFormer paper: https://arxiv.org/pdf/2107.06278
[4 π] Feature Pyramid Network paper: https://arxiv.org/pdf/1612.03144
[5 π] Mask2Former paper: https://arxiv.org/pdf/2112.01527
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow THIS changed Segmentation FOREVER!](https://i.ytimg.com/vi/xQ1Qs1d10Sc/mqdefault.jpg)


![Llama - EXPLAINED!
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π΄] Llama 1 dissertation: https://arxiv.org/pdf/2302.13971.pdf
[2 π΄] Llama 2 dissertation: https://scontent-lax3-1.xx.fbcdn.net/v/t39.2365-6/10000000_662098952474184_2584067087619170692_n.pdf?_nc_cat=105&ccb=1-7&_nc_sid=3c67a6&_nc_ohc=O3eQj9LEMfQAX_IC7oO&_nc_ht=scontent-lax3-1.xx&oh=00_AfDihQ7maFg_ebWGZCxpt1ZYmSfYupRr1HJMyexxrC7nwg&oe=64DA167F
[3 π΄] Llama code: https://github.com/facebookresearch/llama/blob/main/llama/model.py
[4 π΄] Where I got the decoder only transformer architecture: https://ai.stackexchange.com/questions/40179/how-does-the-decoder-only-transformer-architecture-work
[5 π΄] Huggingface models on Llama that you can use for inference: https://huggingface.co/models?search=llama2
[6 π΄] Llama vs Alpaca: https://sapling.ai/llm/alpaca-vs-llama2
[7 π΄] Llama2 file using Qlora: https://colab.research.google.com/drive/12dVqXZMIVxGI0uutU6HG9RWbWPXL3vts?usp=sharing#scrollTo=C2EgqEPDQ8v6
[8 π΄] @1littlecoder s video describing Qlora and how you can fine tune llama: https://www.youtube.com/watch?v=eeM6V5aPjhk
[9 π΄] Autotrain repo for 1 line training: https://github.com/huggingface/autotrain-advanced
[10 π΄] Video describing on how to use Autotrain (@abhishekkrthakur ) : https://www.youtube.com/watch?v=3fsn19OI_C8
PLAYLISTS FROM MY CHANNEL
β Transformers from scratch playlist: https://www.youtube.com/watch?v=QCJQG4DuHT0&list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist of all other videos: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Transformer Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
#chatgpt #deeplearning #machinelearning #bert #gpt Llama - EXPLAINED!](https://i.ytimg.com/vi/yZ9jkgN2xHQ/mqdefault.jpg)

![Informer attention Architecture - FROM SCRATCH!
Here is the architecture of probsparse attention for time series transformers.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Main paper that introduced the Informer: https://arxiv.org/pdf/2012.07436
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Informer attention Architecture - FROM SCRATCH!](https://i.ytimg.com/vi/zcBA2KhTwMg/mqdefault.jpg)