Uploaded June 2026 | Updated November 2026, 3 hours ago
Here is a full timeline of computer vision highlighting key models in the convolution and transformer era.
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 π] Slides: link.excalidraw.com/p/readonly/rOOjaFTdHrsxRvPN2319
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
Here is a full timeline of computer vision highlighting key models in the convolution and transformer era.
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 π] Slides: link.excalidraw.com/p/readonly/rOOjaFTdHrsxRvPN2319
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow

![RAG - Explained!
Lets talk about RAG - a pivotal AI concepts that mitigates hallucinations.
RESOURCES
[1] The Survey for context of this video: https://arxiv.org/pdf/2312.10997
[2] More about converting sentences to vectors: https://youtu.be/O3xbVmpdJwU?si=Xuf8jTz9DLp0J-i4
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
0:50 Pass 1: RAG overview
3:58 Quiz 1
5:06 Pass 2: RAG Details
15:20 Quiz 2
16:18 Pass 3: Advanced RAG
27:25 Quiz 3
28:31 Summary RAG - Explained!](https://i.ytimg.com/vi/WLmsncGSjJ8/mqdefault.jpg)
![How Transformers Learned to See at Every Scale
How do Transformer networks see at scale? Lets talk about this
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π]Transformer paper: https://arxiv.org/pdf/1706.03762
[2 π] BERT paper: https://arxiv.org/pdf/1810.04805
[3 π] Scaling Laws for Transformers: https://arxiv.org/pdf/2001.08361
[4 π] Vision Transformer paper: https://arxiv.org/pdf/2010.11929
[5 π] DEtection TRansformer (DETR): https://arxiv.org/pdf/2005.12872
[6 π] AlexNet paper: https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
[7 π] Swin Transformers: https://arxiv.org/pdf/2103.14030
[8 π] Feature Pyramid Networks paper: https://arxiv.org/pdf/1612.03144
[9 π ] U-Net paper: https://arxiv.org/pdf/1505.04597
[10 π ] RT-DETR paper: https://arxiv.org/pdf/2304.08069
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow How Transformers Learned to See at Every Scale](https://i.ytimg.com/vi/X7pu2J02FS0/mqdefault.jpg)
![How much training data does a neural network need?
Lets answer the question: how much training data does a neural network need?
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Code for Deep Learning 101 playlist: https://github.com/ajhalthor/deep-learning-101
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow How much training data does a neural network need?](https://i.ytimg.com/vi/XVXczyheik0/mqdefault.jpg)
![The complete Transformer Neural Network Code in 300 lines!
Code for the transformer neural network. This is the architecture for the Attention is all you need paper. And this forms the core of ChatGPT and other Large Language models today
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Code for the video: https://github.com/ajhalthor/Transformer-Neural-Network/blob/main/transformer.py
PLAYLISTS FROM MY CHANNEL
β Transformers from scratch playlist: https://www.youtube.com/watch?v=QCJQG4DuHT0&list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist of all other videos: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Transformer Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow The complete Transformer Neural Network Code in 300 lines!](https://i.ytimg.com/vi/Xg5JG30bYik/mqdefault.jpg)
![Evolution of Autoencoders - Explained!
In this video, we take a look at a core component of DALL-E text-to-image generation: discrete autoencoders. What is it? Why do we have it? How does it look? We specifically looks at vanilla Autoencoders, Variational Auto-encoders and VQ-VAEs.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides: https://link.excalidraw.com/p/readonly/GElfVd51jvXhYuQ6yjns
[2 π] Paper that suggests Autoencoders address βback propagation without a teacherβ: https://proceedings.mlr.press/v27/baldi12a/baldi12a.pdf
[3 π] Early paper on auto encoders that compared performance vs PCA (2006): https://www.cs.toronto.edu/~hinton/absps/science.pdf
[4 π] 2013 VAE paper: https://arxiv.org/abs/1312.6114?utm_source=chatgpt.com
[5 π] 2017 VQ-VAE paper: https://papers.nips.cc/paper_files/paper/2017/file/7a98af17e63a0ac09ce2e96d03992fbc-Paper.pdf
[6 π] 2017 paper on discrete variational auto encoders: https://arxiv.org/pdf/1609.02200
[7 π] A digestible, yet formal introduction to discrete VAE: https://arxiv.org/pdf/2505.10344
[8 π] Paper that shows how to recover from posterior collapse: https://openreview.net/pdf/729562a11b8fe6b0af7244d73dea98ec6c5f8376.pdf?utm_source=chatgpt.com
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is DALL-E?
01:08 Autoencoders
02:59 What are Variational Autoencoders?
03:22 How VAE is better suited for generation than AE.
05:18 VAE structure and forward pass
07:09 Reparameterization trick
12:09 VAE loss function
13:49 VAE inference
14:44 What is VQ-VAE, forward pass, loss
18:06 Straight through estimator
20:08 Posterior Collapse
23:52 Discrete representations
25:00 Compatibility with sequence models (and DALL-E)
25:56 Quiz Time
26:52 Summary Evolution of Autoencoders - Explained!](https://i.ytimg.com/vi/XyWNmHZi1oA/mqdefault.jpg)
![Boltzmann Machine - Explained!
Lets talk about Boltzmann Machines
RESOURCES
[1 π] Main paper: https://web.archive.org/web/20110718022336/http://learning.cs.toronto.edu/~hinton/absps/cogscibm.pdf
[2 π] Quick summary: https://www.cs.toronto.edu/~hinton/csc321/readings/boltz321.pdf
[3 π] Geoffry Hintonβs lectures (From 11 c): https://www.youtube.com/watch?v=IP3W7cI01VY&list=PLiPvV5TNogxKKwvKb1RKwkq2hm7ZvpHz0&index=11
[4 π] Another easier to understand summary : https://www.engati.com/glossary/boltzmann-machine
[5 π] University of Toronto :https://www.cs.toronto.edu/~rgrosse/courses/csc321_2017/slides/lec19.pdf
[6 π] Rithvikmath has amazing videos on Gibb sampling (used here to get sample states from the model and use in our learning procedure) : https://www.youtube.com/watch?v=MNHIbOqH3sk
[7 π] Boltzmann Distribution: https://en.wikipedia.org/wiki/Boltzmann_distribution
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
0:13 Pass 1: What is Boltzmann Machine?
4:03 Quiz 1
5:07 Pass 2: How does Boltzmann Machine work?
7:00 How the network learns the probability distribution?
14:22 Quiz 2
16:00 Energy landscape
15:19 Why is it Boltzmann machine?
16:28 Stochastic neuron probability function
19:50 How to derive the learning rule
20:28 How long does training happen?
21:24 Quiz 3
22:16 Summary Boltzmann Machine - Explained!](https://i.ytimg.com/vi/Y8cBT_Qt_fQ/mqdefault.jpg)


![Reinforcement Learning: on-policy vs off-policy algorithms
Lets talk about on-policy vs off-policy algorithms in reinforcement learning
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Reinforcement Learning book: http://incompleteideas.net/book/RLbook2020.pdf
[2] Paradigms of ML: https://idapgroup.com/blog/types-of-machine-learning-out-there/
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Reinforcement Learning: on-policy vs off-policy algorithms](https://i.ytimg.com/vi/YUKUXoUg3Nc/mqdefault.jpg)
![Evolution of Neural Networks: Zero to Hero
RESOURCES
[1 π ] A logical calculus of the ideas immanent in neuron activity (McCulloch-Pitts artificial neuron): https://www.cs.cmu.edu/~./epxing/Class/10715/reading/McCulloch.and.Pitts.pdf
[2 π] The perceptron: A probabilistic model for information storage and organization in the brain: https://www.ling.upenn.edu/courses/cogs501/Rosenblatt1958.pdf
[3 π] An adaptive βAdalineβ neuron using chemical βmemistorsβ: https://isl.stanford.edu/~widrow/papers/t1960anadaptive.pdf
[4 π] Neural networks and physical systems with emergent collective computational abilities (Hopfield nets): https://pmc.ncbi.nlm.nih.gov/articles/instance/346238/pdf/pnas00447-0135.pdf
[5 π] A learning algorithm for Boltzmann Machines: https://web.archive.org/web/20110718022336/http://learning.cs.toronto.edu/~hinton/absps/cogscibm.pdf
[6 π] Learning representations by back propagating errors: http://www.cs.utoronto.ca/~hinton/absps/naturebp.pdf
SUPPLEMENTAL RESOURCES:
[1 π] Action potential - a nice video explanation: https://www.youtube.com/watch?v=BbUcWbtVjT4
[2 π ] Nice notes with MP neurons: https://marlin.life.utsa.edu/mcculloch-and-pitts.html
[3 π] Synaptic Plasticity: https://www.youtube.com/watch?v wakk5Iwqj8
[4 π ] Cell assembly in hebbian learning: http://www.scholarpedia.org/article/Cell_assemblies
[5 π] Perceptron demo: https://sergedesmedt.github.io/MathOfNeuralNetworks/PerceptronLearningMath.html#learn_perceptron_learningrule_animation
[6 π] Perceptron convergence theorem explained: https://www.youtube.com/watch?v=kObhWlqIeD8&t=250s
[7 π] A symbolic analysis of relay and switching circuits: https://www.cs.virginia.edu/~evans/greatworks/shannon38.pdf
[8 π ] Geoffrey Hintonβs lecture on Hopfield Nets: https://www.youtube.com/watch?v=IP3W7cI01VY&list=PLiPvV5TNogxKKwvKb1RKwkq2hm7ZvpHz0&index=11
[9 π] Gibbs sampling used in learning in Boltzmann machines (video by Rithvikmath): https://www.youtube.com/watch?v=MNHIbOqH3sk
[10 π] Lecture notes on the mathematics behind Boltzmann machines: https://www.cs.toronto.edu/~rgrosse/courses/csc321_2017/slides/lec19.pdf
[11 π] Cauchyβs paper on gradient descent: http://www.kurims.kyoto-u.ac.jp/EMIS/journals/DMJDMV/vol-ismp/40_lemarechal-claude.pdf
[12 π] Hinton explaining the mechanics of back propagation introduced by Rumelhart, Williams and himself: https://www.youtube.com/watch?v=VCT1N0EsGj0
[13 π ] Reverse mode automatic differentiation (like back propagation): https://rufflewind.com/2016-12-30/reverse-mode-automatic-differentiation
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
00:25 1. The artificial neuron
19:46 2. Perceptron
42:12 3. ADALINE
59:01 4. Hopfield Networks
1:18:57 5. Boltzmann Machines
1:42:20 6. Multilayer Perceptron
1:55:25 7. Evolution of Back propagation
2:22:27 Conclusion Evolution of Neural Networks: Zero to Hero](https://i.ytimg.com/vi/Z-numtJvK2o/mqdefault.jpg)