Uploaded March 2025 | Updated November 2026, 3 hours ago
Let's understand the evolution of back propagation. Who created it?
Last video on multiplayer perceptron: youtu.be/poNXEd3jCwI
RESOURCES
[1 ๐] 1847, Cauchy invented gradient descent. Here is the English rendition of this work with comments: kurims.kyoto-u.ac.jp/EMIS/journals/DMJDMV/vol-ismp/40_lemarechal-claude.pdf
[2 ๐] Hinton explaining the mechanics of back propagation introduced by Rumelhart, Williams and himself: youtube.com/watch?v=VCT1N0EsGj0
[3 ๐] Proof that gradient vector points in the direction of steepest ascent: sootlasten.github.io/2017/gradient-steepest-ascent
[4 ๐] Online 3D plotter: c3d.libretexts.org/CalcPlot3D/index.html
[5 ๐] 1986 paper that is the most famous implementation of back propagation: semanticscholar.org/paper/Learning-representations-by-back-propagating-errors-Rumelhart-Hinton/052b1d8ce63b07fec3de9dbb583772d860b7c769
[6 ๐] Henry J Kellyโs 1960 paper on determining the Optimal flight path and hence developing their own version of back propagation: gwern.net/doc/statistics/decision/1960-kelley.pdf
[7 ๐] Backstory of back propagation: yuxi-liu-wired.github.io/essays/posts/backstory-of-backpropagation
[8 ๐] Tourist guide to differential equations by 3blue1brown: youtube.com/watch?v=p_di4Zn4wz4
[9 ๐] Khan Academy on derivatives, directional derivatives: khanacademy.org/math/multivariable-calculus/multivariable-derivatives/gradient-and-directional-derivatives/v/gradient
[10 ๐] A nice tutorial on reverse mode automatic differentiation: rufflewind.com/2016-12-30/reverse-mode-automatic-differentiation
[11 ๐ ] Everything you need to know about control theory. Amazing resource: youtu.be/lBC1nEq0_nk?si=-Jkh7PZl0bjY6LGE
[12 ๐] Thesis by Paul Werbos in 1974 (one of the first successful implementations of a back propagation learning procedure on a multi-layered perceptron): gwern.net/doc/ai/nn/1974-werbos.pdf
[13 ๐] How the adjoint method is similar to the reverse-mode Automatic differentiation: github.com/fancompute/workshop-invdesign/issues/3
[14 ๐] The 1969 book on optimal control by Bryson and Ho: http://e.guigon.free.fr/rsc/book/BrysonHo75.pdf
[15 ๐ ] The adjoint method of gradient calculation: youtube.com/watch?v=Yiz92Ekn7vU
[16 ๐] Nice sheet on method of Lagrange multipliers (this is used in the adjoint state method): https://www.cs.toronto.edu/~fleet/courses/C11/Handouts/LagrangeMultipliers.pdf
ABOUT ME
โญ Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: medium.com/@dataemporium
๐ป Github: github.com/ajhalthor
๐ LinkedIn: linkedin.com/in/ajay-halthor-477974bb
PLAYLISTS FROM MY CHANNEL
โญ Deep Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
โญ Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ Reinforcement Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: imp.i384100.net/MathML
๐ Calculus: imp.i384100.net/Calculus
๐ Statistics for Data Science: imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: imp.i384100.net/BayesianStatistics
๐ Linear Algebra: imp.i384100.net/LinearAlgebra
๐ Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: imp.i384100.net/Deep-Learning
๐ Python for Everybody: imp.i384100.net/python
๐ MLOps Course: imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): imp.i384100.net/NLP
๐ Machine Learning in Production: imp.i384100.net/MLProduction
๐ Data Science Specialization: imp.i384100.net/DataScience
๐ Tensorflow: imp.i384100.net/Tensorflow
CHAPTERS
0:00 Why perceptron convergence learning could no longer be used
2:00 Why Analytical methods are infeasible
4:00 How numerical methods like gradient descent are feasible
7:00 Gradient vector and direction of steepest ascent
13:58 An efficient way to compute gradients
17:32 What is "backward" in back propagation and why
18:48 How this efficient gradient compute method is used in neural networks
20:08 Who invented backprop
23:22 Quiz Time
24:37 Summary
Let's understand the evolution of back propagation. Who created it?
Last video on multiplayer perceptron: youtu.be/poNXEd3jCwI
RESOURCES
[1 ๐] 1847, Cauchy invented gradient descent. Here is the English rendition of this work with comments: kurims.kyoto-u.ac.jp/EMIS/journals/DMJDMV/vol-ismp/40_lemarechal-claude.pdf
[2 ๐] Hinton explaining the mechanics of back propagation introduced by Rumelhart, Williams and himself: youtube.com/watch?v=VCT1N0EsGj0
[3 ๐] Proof that gradient vector points in the direction of steepest ascent: sootlasten.github.io/2017/gradient-steepest-ascent
[4 ๐] Online 3D plotter: c3d.libretexts.org/CalcPlot3D/index.html
[5 ๐] 1986 paper that is the most famous implementation of back propagation: semanticscholar.org/paper/Learning-representations-by-back-propagating-errors-Rumelhart-Hinton/052b1d8ce63b07fec3de9dbb583772d860b7c769
[6 ๐] Henry J Kellyโs 1960 paper on determining the Optimal flight path and hence developing their own version of back propagation: gwern.net/doc/statistics/decision/1960-kelley.pdf
[7 ๐] Backstory of back propagation: yuxi-liu-wired.github.io/essays/posts/backstory-of-backpropagation
[8 ๐] Tourist guide to differential equations by 3blue1brown: youtube.com/watch?v=p_di4Zn4wz4
[9 ๐] Khan Academy on derivatives, directional derivatives: khanacademy.org/math/multivariable-calculus/multivariable-derivatives/gradient-and-directional-derivatives/v/gradient
[10 ๐] A nice tutorial on reverse mode automatic differentiation: rufflewind.com/2016-12-30/reverse-mode-automatic-differentiation
[11 ๐ ] Everything you need to know about control theory. Amazing resource: youtu.be/lBC1nEq0_nk?si=-Jkh7PZl0bjY6LGE
[12 ๐] Thesis by Paul Werbos in 1974 (one of the first successful implementations of a back propagation learning procedure on a multi-layered perceptron): gwern.net/doc/ai/nn/1974-werbos.pdf
[13 ๐] How the adjoint method is similar to the reverse-mode Automatic differentiation: github.com/fancompute/workshop-invdesign/issues/3
[14 ๐] The 1969 book on optimal control by Bryson and Ho: http://e.guigon.free.fr/rsc/book/BrysonHo75.pdf
[15 ๐ ] The adjoint method of gradient calculation: youtube.com/watch?v=Yiz92Ekn7vU
[16 ๐] Nice sheet on method of Lagrange multipliers (this is used in the adjoint state method): https://www.cs.toronto.edu/~fleet/courses/C11/Handouts/LagrangeMultipliers.pdf
ABOUT ME
โญ Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: medium.com/@dataemporium
๐ป Github: github.com/ajhalthor
๐ LinkedIn: linkedin.com/in/ajay-halthor-477974bb
PLAYLISTS FROM MY CHANNEL
โญ Deep Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
โญ Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ Reinforcement Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: imp.i384100.net/MathML
๐ Calculus: imp.i384100.net/Calculus
๐ Statistics for Data Science: imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: imp.i384100.net/BayesianStatistics
๐ Linear Algebra: imp.i384100.net/LinearAlgebra
๐ Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: imp.i384100.net/Deep-Learning
๐ Python for Everybody: imp.i384100.net/python
๐ MLOps Course: imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): imp.i384100.net/NLP
๐ Machine Learning in Production: imp.i384100.net/MLProduction
๐ Data Science Specialization: imp.i384100.net/DataScience
๐ Tensorflow: imp.i384100.net/Tensorflow
CHAPTERS
0:00 Why perceptron convergence learning could no longer be used
2:00 Why Analytical methods are infeasible
4:00 How numerical methods like gradient descent are feasible
7:00 Gradient vector and direction of steepest ascent
13:58 An efficient way to compute gradients
17:32 What is "backward" in back propagation and why
18:48 How this efficient gradient compute method is used in neural networks
20:08 Who invented backprop
23:22 Quiz Time
24:37 Summary
![Region Proposals - Explained!
Lets understand region proposals: what it is, why we do it and how we can achieve this with some code.
ABOUT ME
โญ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: https://medium.com/@dataemporium
๐ป Github: https://github.com/ajhalthor
๐ LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 ๐] Slides used in the video: https://link.excalidraw.com/p/readonly/ckRLqQFeGtBgULeCEFHQ
[2 ๐] Main paper for selective search : https://www.researchgate.net/publication/262270555_Selective_Search_for_Object_Recognition
[3 ๐] Code for the video: https://github.com/ajhalthor/computer-vision-101/blob/main/selective_search.ipynb
[4 ๐] My video on graph based image segmentation used for pre-processing: https://youtu.be/sSx5Qujq0Fs?si=AEOh9wvE-rGxvoat
PLAYLISTS FROM MY CHANNEL
โญ Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
โญ Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
โญ The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
โญ Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
โญ Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: https://imp.i384100.net/MathML
๐ Calculus: https://imp.i384100.net/Calculus
๐ Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
๐ Linear Algebra: https://imp.i384100.net/LinearAlgebra
๐ Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
๐ Python for Everybody: https://imp.i384100.net/python
๐ MLOps Course: https://imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): https://imp.i384100.net/NLP
๐ Machine Learning in Production: https://imp.i384100.net/MLProduction
๐ Data Science Specialization: https://imp.i384100.net/DataScience
๐ Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What are region proposals?
00:23 Why region proposals?
04:59 How to create region proposals with selective search
12:51 Quiz Time
13:55 Summary Region Proposals - Explained!](https://i.ytimg.com/vi/RDdLUm4gLec/mqdefault.jpg)

![Q-learning - Explained!
Lets talk about one of the more important concepts in reinforcement learning: q-learning
ABOUT ME
โญ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: https://medium.com/@dataemporium
๐ป Github: https://github.com/ajhalthor
๐ LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Reinforcement Learning book: http://incompleteideas.net/book/RLbook2020.pdf
[2] Paradigms of ML: https://idapgroup.com/blog/types-of-machine-learning-out-there/
[3] Model Free vs Model Based RL: https://spinningup.openai.com/en/latest/spinningup/rl_intro2.html
[4] Bellman Equation video: https://youtu.be/9JZID-h6ZJ0
[5] Temporal Difference Learning video: https://youtu.be/uJX_72MnKg8?si=KM3nA5bGEVT5T_Vt
PLAYLISTS FROM MY CHANNEL
โญ Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
โญ Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
โญ The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
โญ Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
โญ Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: https://imp.i384100.net/MathML
๐ Calculus: https://imp.i384100.net/Calculus
๐ Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
๐ Linear Algebra: https://imp.i384100.net/LinearAlgebra
๐ Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
๐ Python for Everybody: https://imp.i384100.net/python
๐ MLOps Course: https://imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): https://imp.i384100.net/NLP
๐ Machine Learning in Production: https://imp.i384100.net/MLProduction
๐ Data Science Specialization: https://imp.i384100.net/DataScience
๐ Tensorflow: https://imp.i384100.net/Tensorflow Q-learning - Explained!](https://i.ytimg.com/vi/TiAXhVAZQl8/mqdefault.jpg)
![NLP with Neural Networks | ngram to LLMs
Lets talk about NLP with neural networks and highlight ngrams to Large Language Models (LLMs)
ABOUT ME
โญ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: https://medium.com/@dataemporium
๐ป Github: https://github.com/ajhalthor
๐ LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Code for this video: https://github.com/ajhalthor/deep-learning-101/blob/main/embeddings.ipynb
PLAYLISTS FROM MY CHANNEL
โญ Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
โญ Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
โญ Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: https://imp.i384100.net/MathML
๐ Calculus: https://imp.i384100.net/Calculus
๐ Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
๐ Linear Algebra: https://imp.i384100.net/LinearAlgebra
๐ Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
๐ Python for Everybody: https://imp.i384100.net/python
๐ MLOps Course: https://imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): https://imp.i384100.net/NLP
๐ Machine Learning in Production: https://imp.i384100.net/MLProduction
๐ Data Science Specialization: https://imp.i384100.net/DataScience
๐ Tensorflow: https://imp.i384100.net/Tensorflow NLP with Neural Networks | ngram to LLMs](https://i.ytimg.com/vi/TjIq_rqJSgo/mqdefault.jpg)


![Full Timeline of Computer Vision & Neural Networks
Here is a full timeline of computer vision highlighting key models in the convolution and transformer era.
ABOUT ME
โญ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: https://medium.com/@dataemporium
๐ป Github: https://github.com/ajhalthor
๐ LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 ๐] Slides: https://link.excalidraw.com/p/readonly/rOOjaFTdHrsxRvPN2319
PLAYLISTS FROM MY CHANNEL
โญ Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
โญ ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
โญ Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
โญ The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
โญ Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
โญ Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: https://imp.i384100.net/MathML
๐ Calculus: https://imp.i384100.net/Calculus
๐ Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
๐ Linear Algebra: https://imp.i384100.net/LinearAlgebra
๐ Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
๐ Python for Everybody: https://imp.i384100.net/python
๐ MLOps Course: https://imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): https://imp.i384100.net/NLP
๐ Machine Learning in Production: https://imp.i384100.net/MLProduction
๐ Data Science Specialization: https://imp.i384100.net/DataScience
๐ Tensorflow: https://imp.i384100.net/Tensorflow Full Timeline of Computer Vision & Neural Networks](https://i.ytimg.com/vi/VqjQuQmKhYk/mqdefault.jpg)

![RAG - Explained!
Lets talk about RAG - a pivotal AI concepts that mitigates hallucinations.
RESOURCES
[1] The Survey for context of this video: https://arxiv.org/pdf/2312.10997
[2] More about converting sentences to vectors: https://youtu.be/O3xbVmpdJwU?si=Xuf8jTz9DLp0J-i4
ABOUT ME
โญ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: https://medium.com/@dataemporium
๐ป Github: https://github.com/ajhalthor
๐ LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
โญ Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
โญ Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: https://imp.i384100.net/MathML
๐ Calculus: https://imp.i384100.net/Calculus
๐ Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
๐ Linear Algebra: https://imp.i384100.net/LinearAlgebra
๐ Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
๐ Python for Everybody: https://imp.i384100.net/python
๐ MLOps Course: https://imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): https://imp.i384100.net/NLP
๐ Machine Learning in Production: https://imp.i384100.net/MLProduction
๐ Data Science Specialization: https://imp.i384100.net/DataScience
๐ Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
0:50 Pass 1: RAG overview
3:58 Quiz 1
5:06 Pass 2: RAG Details
15:20 Quiz 2
16:18 Pass 3: Advanced RAG
27:25 Quiz 3
28:31 Summary RAG - Explained!](https://i.ytimg.com/vi/WLmsncGSjJ8/mqdefault.jpg)
![How Transformers Learned to See at Every Scale
How do Transformer networks see at scale? Lets talk about this
ABOUT ME
โญ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: https://medium.com/@dataemporium
๐ป Github: https://github.com/ajhalthor
๐ LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 ๐]Transformer paper: https://arxiv.org/pdf/1706.03762
[2 ๐] BERT paper: https://arxiv.org/pdf/1810.04805
[3 ๐] Scaling Laws for Transformers: https://arxiv.org/pdf/2001.08361
[4 ๐] Vision Transformer paper: https://arxiv.org/pdf/2010.11929
[5 ๐] DEtection TRansformer (DETR): https://arxiv.org/pdf/2005.12872
[6 ๐] AlexNet paper: https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
[7 ๐] Swin Transformers: https://arxiv.org/pdf/2103.14030
[8 ๐] Feature Pyramid Networks paper: https://arxiv.org/pdf/1612.03144
[9 ๐ ] U-Net paper: https://arxiv.org/pdf/1505.04597
[10 ๐ ] RT-DETR paper: https://arxiv.org/pdf/2304.08069
PLAYLISTS FROM MY CHANNEL
โญ Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
โญ ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
โญ Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
โญ The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
โญ Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
โญ Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: https://imp.i384100.net/MathML
๐ Calculus: https://imp.i384100.net/Calculus
๐ Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
๐ Linear Algebra: https://imp.i384100.net/LinearAlgebra
๐ Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
๐ Python for Everybody: https://imp.i384100.net/python
๐ MLOps Course: https://imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): https://imp.i384100.net/NLP
๐ Machine Learning in Production: https://imp.i384100.net/MLProduction
๐ Data Science Specialization: https://imp.i384100.net/DataScience
๐ Tensorflow: https://imp.i384100.net/Tensorflow How Transformers Learned to See at Every Scale](https://i.ytimg.com/vi/X7pu2J02FS0/mqdefault.jpg)
![How much training data does a neural network need?
Lets answer the question: how much training data does a neural network need?
ABOUT ME
โญ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
๐ Medium Blog: https://medium.com/@dataemporium
๐ป Github: https://github.com/ajhalthor
๐ LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Code for Deep Learning 101 playlist: https://github.com/ajhalthor/deep-learning-101
PLAYLISTS FROM MY CHANNEL
โญ Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
โญ Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
โญ ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
๐ Mathematics for Machine Learning: https://imp.i384100.net/MathML
๐ Calculus: https://imp.i384100.net/Calculus
๐ Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
๐ Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
๐ Linear Algebra: https://imp.i384100.net/LinearAlgebra
๐ Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
๐ โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
๐ Python for Everybody: https://imp.i384100.net/python
๐ MLOps Course: https://imp.i384100.net/MLOps
๐ Natural Language Processing (NLP): https://imp.i384100.net/NLP
๐ Machine Learning in Production: https://imp.i384100.net/MLProduction
๐ Data Science Specialization: https://imp.i384100.net/DataScience
๐ Tensorflow: https://imp.i384100.net/Tensorflow How much training data does a neural network need?](https://i.ytimg.com/vi/XVXczyheik0/mqdefault.jpg)