Uploaded January 2024 | Updated November 2026, 3 hours ago
Greetings fellow learners! This is the 2nd video in a playlist of videos where are are going to talk about the fundamentals of building neural networks! Here, we cover back propagation
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1] Code to build first neural network: github.com/ajhalthor/deep-learning-101/tree/main
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
Greetings fellow learners! This is the 2nd video in a playlist of videos where are are going to talk about the fundamentals of building neural networks! Here, we cover back propagation
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1] Code to build first neural network: github.com/ajhalthor/deep-learning-101/tree/main
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow

![βComputer Visionβ is now βDeep Learningβ
How did Computer vision become all about neural networks? There is a story behind that.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Hubel & Wiesel Experiment: https://www.researchgate.net/figure/Left-Experimental-setup-from-Hubel-Wiesel-136-137-adapted-from-253-Chapter-11_fig4_337360115
[2 π] Hubel & Wiesel Paper: https://physoc.onlinelibrary.wiley.com/doi/abs/10.1113/jphysiol.1968.sp008455?sid=nlm%3Apubmed
[3 π] Neocognitron Paper: https://www.rctn.org/bruno/public/papers/Fukushima1980.pdf
[4 π] Back propagation paper: https://www.iro.umontreal.ca/~vincentp/ift3395/lectures/backprop_old.pdf
[5 π] LeNet-1 (good paper to get intuition on how CNNs are constructed): https://masters.donntu.ru/2012/fknt/umiarov/library/lecun.pdf
[6 π] LeNet-5 paper: http://vision.stanford.edu/cs598_spring07/papers/Lecun98.pdf
[7 π] SIFT paper: https://www.cs.ubc.ca/~lowe/papers/ijcv04.pdf
[8 π] Viola Jones paper: https://www.cs.cmu.edu/~efros/courses/LBMV07/Papers/viola-cvpr-01.pdf
[9 π] Histogram of Gradients (HoG) paper: https://www.cs.princeton.edu/courses/archive/fall13/cos429/papers/Dalal05.pdf
[10 π] Nvidia timeline: https://www.nvidia.com/content/timeline/time_02.html
[11 π] ImageNet paper: https://www.image-net.org/static_files/papers/imagenet_cvpr09.pdf
[12 π] AlexNet paper: https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
[13 π] ResNet paper: https://arxiv.org/pdf/1512.03385
[14 π] U-Net paper: https://arxiv.org/pdf/1505.04597
[15 π] YOLO paper: https://arxiv.org/pdf/1506.02640
[16 π] Deep Convolution GANs paper: https://arxiv.org/pdf/1511.06434
[17 π] Transformer Paper: https://arxiv.org/pdf/1706.03762
[18 π] CLIP paper: https://arxiv.org/pdf/2103.00020
[19 π] DINO paper: https://arxiv.org/pdf/2104.14294
[20 π β] Timeline of Computer vision video on my channel: https://youtu.be/VqjQuQmKhYk?si=HflXIAW-w5yor_ey
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow βComputer Visionβ is now βDeep Learningβ](https://i.ytimg.com/vi/OXdfdDDhCo0/mqdefault.jpg)
![How was object detection done before neural networks?
Lets understand how object detection was done before neural networks became the state of the art. Specifically, we will talk about using wavelets for face detection.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides used in the video: https://link.excalidraw.com/p/readonly/I6uUCFQ1QKmLxk4f5018
[2 π] Main paper used for the basis of this video (1998): https://static.aminer.org/pdf/PDF/000/293/432/a_general_framework_for_object_detection.pdf?utm_source=chatgpt.com
[3 π] A very technical paper that introduces wavelets in signal processing: https://www.researchgate.net/publication/3192100_Mallat_SG_A_Theory_of_Multiresolution_Signal_Decomposition_The_Wavelet_Representation_IEEE_Trans_Pattern_Anal_Machine_Intell_11_674-693
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is object detection
00:22 Why object detection is a complex problem
01:06 Using wavelets as feature detectors.
02:29 Training data examples
02:58 Training process
07:35 Inference
12:05 Quiz Time
13:15 Summary How was object detection done before neural networks?](https://i.ytimg.com/vi/Ocy54ea5Gd4/mqdefault.jpg)

![Transfer Learning - EXPLAINED!
Lets talk about a neural network concept called transfer learning. We use this in BERT, GPT and the large language models today.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Code for this video: https://github.com/huggingface/notebooks/blob/main/examples/question_answering.ipynb
[2] Code for Deep Learning 101 playlist: https://github.com/ajhalthor/deep-learning-101
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Transfer Learning - EXPLAINED!](https://i.ytimg.com/vi/QHS9ZZBdK-g/mqdefault.jpg)
![75 years of Language Models
Here are 20 research papers you should read to master Language modeling.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PAPERS
[1 π] A Mathematical Theory of Communication: https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf
[2 π] A Neural Probabilistic Language Model: https://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf
[3 π] NLP (Almost) from scratch: https://www.jmlr.org/papers/volume12/collobert11a/collobert11a.pdf
[4 π] Phoneme Recognition using Time Delay Neural Networks: https://www.cs.toronto.edu/~fritz/absps/waibelTDNN.pdf
[5 π] Efficient Estimation of words in vector space: https://arxiv.org/pdf/1301.3781.pdf
[6 π] GloVe: https://nlp.stanford.edu/pubs/glove.pdf
[7 π] Enriching word vectors with subword information: https://arxiv.org/pdf/1607.04606.pdf
[8 π] A Convolution Neural Network for modeling sentences: https://arxiv.org/pdf/1404.2188.pdf
[9 π] Learning Internal Representations by error propagation: https://apps.dtic.mil/dtic/tr/fulltext/u2/a164453.pdf
[10 π] Sequence Modeling (from the deep learning book): https://www.deeplearningbook.org/contents/rnn.html#pf1d
[11 π] Long Short Term Memory: http://www.bioinf.jku.at/publications/older/2604.pdf
[12 π] Colahs blog to understanding LSTM: https://colah.github.io/posts/2015-08-Understanding-LSTMs/
[13 π] Training Recurrent Neural Networks (PhD Thesis): https://www.cs.utoronto.ca/~ilya/pubs/ilya_sutskever_phd_thesis.pdf
[14 π] Deep contextualized word representations: https://arxiv.org/pdf/1802.05365.pdf
[15 π] Attention is all you need: https://arxiv.org/pdf/1706.03762.pdf
[16π] BERT: https://arxiv.org/pdf/1810.04805.pdf
[17 π] Improving language understanding by generative pretraining: https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
[18 π] Language Models are multi task learners:https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
[19 π] Language models are few shot learners: https://arxiv.org/pdf/2005.14165.pdf
[20 π] Sentence BERT: https://arxiv.org/pdf/1908.10084.pdf
[21 π] ChatGPT blog: https://openai.com/blog/chatgpt
[22 π] Llama-2: https://scontent-lax3-1.xx.fbcdn.net/v/t39.2365-6/10000000_662098952474184_2584067087619170692_n.pdf?_nc_cat=105&ccb=1-7&_nc_sid=3c67a6&_nc_ohc=cvmnxtGA6rQAX9vXmYA&_nc_ht=scontent-lax3-1.xx&oh=00_AfAfUpzEkX3nP_ptxAOoqKL2pO7s0fzAsAyYEXPFmg1fLQ&oe=64E1FF7F
MY VIDEOS ON THESE TOPICS
π» Convolution in NLP: https://www.youtube.com/watch?v=AGWieLbom_g
π» LSTM: https://www.youtube.com/watch?v=QciIcRxJvsM
π» Transformers: https://www.youtube.com/watch?v=TQQlZhbC5ps
π» Coding Transformers (playlist): https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
π» BERT: https://www.youtube.com/watch?v=xI0HHN5XKDo
π» GPT: https://www.youtube.com/watch?v=3IweGfgytgY
π» ChatGPT: https://www.youtube.com/watch?v=NpmnWgQgcsA
π» Llama: https://www.youtube.com/watch?v=yZ9jkgN2xHQ&t=220s
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
#chatgpt #deeplearning #machinelearning #bert #gpt 75 years of Language Models](https://i.ytimg.com/vi/QQIwfpOY-qA/mqdefault.jpg)
![LLM Self-Taught Reasoning - Explained!
Lets talk about how LLMs can better learn to do Arithmetic using Self-Taught Reasoning (STaR).
RESOURCES
[1] Chain-of-Thought Prompting elicits reasoning in LLMs: https://arxiv.org/pdf/2201.11903
[2] Self-Taught Reasoner : https://arxiv.org/pdf/2203.14465
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
1:13 Pass 1: Why STaR?
5:36 Quiz Time 1
6:38 Pass 2: What and How STaR?
10:30 Quiz Time 2
11:40 Pass 3: Performance & Limitations
15:17 Quiz Time 3
16:29 Summary LLM Self-Taught Reasoning - Explained!](https://i.ytimg.com/vi/QRP70U6V6Lc/mqdefault.jpg)
![Multi Armed Bandits - Reinforcement Learning Explained!
Lets talk about a reinforcement learning strategy called Multi Armed Bandits to k-armed bandits.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Reinforcement Learning book: http://incompleteideas.net/book/RLbook2020.pdf
[2] Paradigms of ML: https://idapgroup.com/blog/types-of-machine-learning-out-there/
[3] Original Code for MAB: https://github.com/ankonzoid/LearningX/blob/master/classical_RL/multiarmed_bandit/multiarmed_bandit.py
[4] My code with some more comments: https://github.com/ajhalthor/multi-armed-bandit
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Multi Armed Bandits - Reinforcement Learning Explained!](https://i.ytimg.com/vi/QTZYOPiQTUc/mqdefault.jpg)

![Evolution of back propagation: Who invented it?
Lets understand the evolution of back propagation. Who created it?
Last video on multiplayer perceptron: https://youtu.be/poNXEd3jCwI
RESOURCES
[1 π] 1847, Cauchy invented gradient descent. Here is the English rendition of this work with comments: http://www.kurims.kyoto-u.ac.jp/EMIS/journals/DMJDMV/vol-ismp/40_lemarechal-claude.pdf
[2 π] Hinton explaining the mechanics of back propagation introduced by Rumelhart, Williams and himself: https://www.youtube.com/watch?v=VCT1N0EsGj0
[3 π] Proof that gradient vector points in the direction of steepest ascent: https://sootlasten.github.io/2017/gradient-steepest-ascent/
[4 π] Online 3D plotter: https://c3d.libretexts.org/CalcPlot3D/index.html
[5 π] 1986 paper that is the most famous implementation of back propagation: https://www.semanticscholar.org/paper/Learning-representations-by-back-propagating-errors-Rumelhart-Hinton/052b1d8ce63b07fec3de9dbb583772d860b7c769
[6 π] Henry J Kellyβs 1960 paper on determining the Optimal flight path and hence developing their own version of back propagation: https://gwern.net/doc/statistics/decision/1960-kelley.pdf
[7 π] Backstory of back propagation: https://yuxi-liu-wired.github.io/essays/posts/backstory-of-backpropagation
[8 π] Tourist guide to differential equations by 3blue1brown: https://www.youtube.com/watch?v=p_di4Zn4wz4
[9 π] Khan Academy on derivatives, directional derivatives: https://www.khanacademy.org/math/multivariable-calculus/multivariable-derivatives/gradient-and-directional-derivatives/v/gradient
[10 π] A nice tutorial on reverse mode automatic differentiation: https://rufflewind.com/2016-12-30/reverse-mode-automatic-differentiation
[11 π ] Everything you need to know about control theory. Amazing resource: https://youtu.be/lBC1nEq0_nk?si Jkh7PZl0bjY6LGE
[12 π] Thesis by Paul Werbos in 1974 (one of the first successful implementations of a back propagation learning procedure on a multi-layered perceptron): https://gwern.net/doc/ai/nn/1974-werbos.pdf
[13 π] How the adjoint method is similar to the reverse-mode Automatic differentiation: https://github.com/fancompute/workshop-invdesign/issues/3
[14 π] The 1969 book on optimal control by Bryson and Ho: http://e.guigon.free.fr/rsc/book/BrysonHo75.pdf
[15 π ] The adjoint method of gradient calculation: https://www.youtube.com/watch?v=Yiz92Ekn7vU
[16 π] Nice sheet on method of Lagrange multipliers (this is used in the adjoint state method): https://www.cs.toronto.edu/~fleet/courses/C11/Handouts/LagrangeMultipliers.pdf
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Why perceptron convergence learning could no longer be used
2:00 Why Analytical methods are infeasible
4:00 How numerical methods like gradient descent are feasible
7:00 Gradient vector and direction of steepest ascent
13:58 An efficient way to compute gradients
17:32 What is backward in back propagation and why
18:48 How this efficient gradient compute method is used in neural networks
20:08 Who invented backprop
23:22 Quiz Time
24:37 Summary Evolution of back propagation: Who invented it?](https://i.ytimg.com/vi/QojD_Moa7oE/mqdefault.jpg)
![Region Proposals - Explained!
Lets understand region proposals: what it is, why we do it and how we can achieve this with some code.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides used in the video: https://link.excalidraw.com/p/readonly/ckRLqQFeGtBgULeCEFHQ
[2 π] Main paper for selective search : https://www.researchgate.net/publication/262270555_Selective_Search_for_Object_Recognition
[3 π] Code for the video: https://github.com/ajhalthor/computer-vision-101/blob/main/selective_search.ipynb
[4 π] My video on graph based image segmentation used for pre-processing: https://youtu.be/sSx5Qujq0Fs?si=AEOh9wvE-rGxvoat
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What are region proposals?
00:23 Why region proposals?
04:59 How to create region proposals with selective search
12:51 Quiz Time
13:55 Summary Region Proposals - Explained!](https://i.ytimg.com/vi/RDdLUm4gLec/mqdefault.jpg)