Uploaded April 2025 | Updated November 2026, 1 hour ago
Reinforcement Learning 101
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 π] Reinforcement Learning book: incompleteideas.net/book/RLbook2020.pdf
[2 π] Paradigms of ML: idapgroup.com/blog/types-of-machine-learning-out-there
[3 π] ChatGPT blog: openai.com/blog/chatgpt
[4 π] Model Free vs Model Based RL: spinningup.openai.com/en/latest/spinningup/rl_intro2.html
[5 π] Original Code for MAB: github.com/ankonzoid/LearningX/blob/master/classical_RL/multiarmed_bandit/multiarmed_bandit.py
[6 π] My code with some more comments: github.com/ajhalthor/multi-armed-bandit
[7 π] Monte Carlo Video referenced: youtube.com/watch?v=mECgLyCzTQU
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
TIMESTAMPS
00:00 Part 1: Elements of Reinforcement Learning
13:17 Part 2: Multi Armed Bandits
23:30 Part 3: Markov Decision Process
31:25 Part 4 Bellman Equation
40:14 Part 5: Q Learning
51:51 Part 6: On policy vs Off Policy
01:04:24 Part 7: Monte Carlo in RL
01:13:55 Part 8: Deep Q Networks
01:21:05 Part 9: Proximal Policy Optimization (PPO)
01:30:25 Part 10: RLHF
Reinforcement Learning 101
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 π] Reinforcement Learning book: incompleteideas.net/book/RLbook2020.pdf
[2 π] Paradigms of ML: idapgroup.com/blog/types-of-machine-learning-out-there
[3 π] ChatGPT blog: openai.com/blog/chatgpt
[4 π] Model Free vs Model Based RL: spinningup.openai.com/en/latest/spinningup/rl_intro2.html
[5 π] Original Code for MAB: github.com/ankonzoid/LearningX/blob/master/classical_RL/multiarmed_bandit/multiarmed_bandit.py
[6 π] My code with some more comments: github.com/ajhalthor/multi-armed-bandit
[7 π] Monte Carlo Video referenced: youtube.com/watch?v=mECgLyCzTQU
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
TIMESTAMPS
00:00 Part 1: Elements of Reinforcement Learning
13:17 Part 2: Multi Armed Bandits
23:30 Part 3: Markov Decision Process
31:25 Part 4 Bellman Equation
40:14 Part 5: Q Learning
51:51 Part 6: On policy vs Off Policy
01:04:24 Part 7: Monte Carlo in RL
01:13:55 Part 8: Deep Q Networks
01:21:05 Part 9: Proximal Policy Optimization (PPO)
01:30:25 Part 10: RLHF
![The first artificial neuron - Explained!
In this video, we explore the first artificial neuron created in the 1940s that kicked off the century old field of AI as we know today
RESOURCES
[1 π] Main paper (1943): https://www.cs.cmu.edu/~./epxing/Class/10715/reading/McCulloch.and.Pitts.pdf
[2 π] Great video on action potential: https://www.youtube.com/watch?v=BbUcWbtVjT4
[3 π] Nice summary of M-P Artificial Neuron: https://marlin.life.utsa.edu/mcculloch-and-pitts.html
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
0:51 Pass 1: What is the artificial neuron?
3:53 Quiz Time 1
4:53 Pass 2: Working of a biological neuron
9:28 Quiz Time 2
10:32 Pass 3: Artificial neuron details
17:49 Quiz Time 3
18:51 Summary The first artificial neuron - Explained!](https://i.ytimg.com/vi/NEKcvmk8U8s/mqdefault.jpg)

![The complete guide to Transformer neural Networks!
Lets do a deep dive into the Transformer Neural Network Architecture for language translation.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[ 1 π] Transformer Architecture Image :https://github.com/ajhalthor/Transformer-Neural-Network/blob/main/Transformer_Architecture_complete.png
[2 π] draw.io version of the image for clarity: https://github.com/ajhalthor/Transformer-Neural-Network/blob/main/Transformer_Architecture_complete.drawio
PLAYLISTS FROM MY CHANNEL
β Transformers from scratch playlist: https://www.youtube.com/watch?v=QCJQG4DuHT0&list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist of all other videos: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Transformer Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
TIMESTAMPS
0:00 Introduction
1:38 Transformer at a high level
4:15 Why Batch Data? Why Fixed Length Sequence?
6:13 Embeddings
7:00 Positional Encodings
7:58 Query, Key and Value vectors
9:19 Masked Multi Head Self Attention
14:46 Residual Connections
15:50 Layer Normalization
17:57 Decoder
20:12 Masked Multi Head Cross Attention
22:47
24:03 Tokenization & Generating the next translated word
26:00 Transformer Inference Example The complete guide to Transformer neural Networks!](https://i.ytimg.com/vi/Nw_PJdmydZY/mqdefault.jpg)
![Backpropagation in Neural Networks - EXPLAINED!
Greetings fellow learners! This is the 2nd video in a playlist of videos where are are going to talk about the fundamentals of building neural networks! Here, we cover back propagation
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Code to build first neural network: https://github.com/ajhalthor/deep-learning-101/tree/main
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Backpropagation in Neural Networks - EXPLAINED!](https://i.ytimg.com/vi/O3sRvkUBag0/mqdefault.jpg)

![βComputer Visionβ is now βDeep Learningβ
How did Computer vision become all about neural networks? There is a story behind that.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Hubel & Wiesel Experiment: https://www.researchgate.net/figure/Left-Experimental-setup-from-Hubel-Wiesel-136-137-adapted-from-253-Chapter-11_fig4_337360115
[2 π] Hubel & Wiesel Paper: https://physoc.onlinelibrary.wiley.com/doi/abs/10.1113/jphysiol.1968.sp008455?sid=nlm%3Apubmed
[3 π] Neocognitron Paper: https://www.rctn.org/bruno/public/papers/Fukushima1980.pdf
[4 π] Back propagation paper: https://www.iro.umontreal.ca/~vincentp/ift3395/lectures/backprop_old.pdf
[5 π] LeNet-1 (good paper to get intuition on how CNNs are constructed): https://masters.donntu.ru/2012/fknt/umiarov/library/lecun.pdf
[6 π] LeNet-5 paper: http://vision.stanford.edu/cs598_spring07/papers/Lecun98.pdf
[7 π] SIFT paper: https://www.cs.ubc.ca/~lowe/papers/ijcv04.pdf
[8 π] Viola Jones paper: https://www.cs.cmu.edu/~efros/courses/LBMV07/Papers/viola-cvpr-01.pdf
[9 π] Histogram of Gradients (HoG) paper: https://www.cs.princeton.edu/courses/archive/fall13/cos429/papers/Dalal05.pdf
[10 π] Nvidia timeline: https://www.nvidia.com/content/timeline/time_02.html
[11 π] ImageNet paper: https://www.image-net.org/static_files/papers/imagenet_cvpr09.pdf
[12 π] AlexNet paper: https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
[13 π] ResNet paper: https://arxiv.org/pdf/1512.03385
[14 π] U-Net paper: https://arxiv.org/pdf/1505.04597
[15 π] YOLO paper: https://arxiv.org/pdf/1506.02640
[16 π] Deep Convolution GANs paper: https://arxiv.org/pdf/1511.06434
[17 π] Transformer Paper: https://arxiv.org/pdf/1706.03762
[18 π] CLIP paper: https://arxiv.org/pdf/2103.00020
[19 π] DINO paper: https://arxiv.org/pdf/2104.14294
[20 π β] Timeline of Computer vision video on my channel: https://youtu.be/VqjQuQmKhYk?si=HflXIAW-w5yor_ey
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow βComputer Visionβ is now βDeep Learningβ](https://i.ytimg.com/vi/OXdfdDDhCo0/mqdefault.jpg)
![How was object detection done before neural networks?
Lets understand how object detection was done before neural networks became the state of the art. Specifically, we will talk about using wavelets for face detection.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides used in the video: https://link.excalidraw.com/p/readonly/I6uUCFQ1QKmLxk4f5018
[2 π] Main paper used for the basis of this video (1998): https://static.aminer.org/pdf/PDF/000/293/432/a_general_framework_for_object_detection.pdf?utm_source=chatgpt.com
[3 π] A very technical paper that introduces wavelets in signal processing: https://www.researchgate.net/publication/3192100_Mallat_SG_A_Theory_of_Multiresolution_Signal_Decomposition_The_Wavelet_Representation_IEEE_Trans_Pattern_Anal_Machine_Intell_11_674-693
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is object detection
00:22 Why object detection is a complex problem
01:06 Using wavelets as feature detectors.
02:29 Training data examples
02:58 Training process
07:35 Inference
12:05 Quiz Time
13:15 Summary How was object detection done before neural networks?](https://i.ytimg.com/vi/Ocy54ea5Gd4/mqdefault.jpg)

![Transfer Learning - EXPLAINED!
Lets talk about a neural network concept called transfer learning. We use this in BERT, GPT and the large language models today.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Code for this video: https://github.com/huggingface/notebooks/blob/main/examples/question_answering.ipynb
[2] Code for Deep Learning 101 playlist: https://github.com/ajhalthor/deep-learning-101
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Transfer Learning - EXPLAINED!](https://i.ytimg.com/vi/QHS9ZZBdK-g/mqdefault.jpg)
![75 years of Language Models
Here are 20 research papers you should read to master Language modeling.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PAPERS
[1 π] A Mathematical Theory of Communication: https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf
[2 π] A Neural Probabilistic Language Model: https://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf
[3 π] NLP (Almost) from scratch: https://www.jmlr.org/papers/volume12/collobert11a/collobert11a.pdf
[4 π] Phoneme Recognition using Time Delay Neural Networks: https://www.cs.toronto.edu/~fritz/absps/waibelTDNN.pdf
[5 π] Efficient Estimation of words in vector space: https://arxiv.org/pdf/1301.3781.pdf
[6 π] GloVe: https://nlp.stanford.edu/pubs/glove.pdf
[7 π] Enriching word vectors with subword information: https://arxiv.org/pdf/1607.04606.pdf
[8 π] A Convolution Neural Network for modeling sentences: https://arxiv.org/pdf/1404.2188.pdf
[9 π] Learning Internal Representations by error propagation: https://apps.dtic.mil/dtic/tr/fulltext/u2/a164453.pdf
[10 π] Sequence Modeling (from the deep learning book): https://www.deeplearningbook.org/contents/rnn.html#pf1d
[11 π] Long Short Term Memory: http://www.bioinf.jku.at/publications/older/2604.pdf
[12 π] Colahs blog to understanding LSTM: https://colah.github.io/posts/2015-08-Understanding-LSTMs/
[13 π] Training Recurrent Neural Networks (PhD Thesis): https://www.cs.utoronto.ca/~ilya/pubs/ilya_sutskever_phd_thesis.pdf
[14 π] Deep contextualized word representations: https://arxiv.org/pdf/1802.05365.pdf
[15 π] Attention is all you need: https://arxiv.org/pdf/1706.03762.pdf
[16π] BERT: https://arxiv.org/pdf/1810.04805.pdf
[17 π] Improving language understanding by generative pretraining: https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
[18 π] Language Models are multi task learners:https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
[19 π] Language models are few shot learners: https://arxiv.org/pdf/2005.14165.pdf
[20 π] Sentence BERT: https://arxiv.org/pdf/1908.10084.pdf
[21 π] ChatGPT blog: https://openai.com/blog/chatgpt
[22 π] Llama-2: https://scontent-lax3-1.xx.fbcdn.net/v/t39.2365-6/10000000_662098952474184_2584067087619170692_n.pdf?_nc_cat=105&ccb=1-7&_nc_sid=3c67a6&_nc_ohc=cvmnxtGA6rQAX9vXmYA&_nc_ht=scontent-lax3-1.xx&oh=00_AfAfUpzEkX3nP_ptxAOoqKL2pO7s0fzAsAyYEXPFmg1fLQ&oe=64E1FF7F
MY VIDEOS ON THESE TOPICS
π» Convolution in NLP: https://www.youtube.com/watch?v=AGWieLbom_g
π» LSTM: https://www.youtube.com/watch?v=QciIcRxJvsM
π» Transformers: https://www.youtube.com/watch?v=TQQlZhbC5ps
π» Coding Transformers (playlist): https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
π» BERT: https://www.youtube.com/watch?v=xI0HHN5XKDo
π» GPT: https://www.youtube.com/watch?v=3IweGfgytgY
π» ChatGPT: https://www.youtube.com/watch?v=NpmnWgQgcsA
π» Llama: https://www.youtube.com/watch?v=yZ9jkgN2xHQ&t=220s
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
#chatgpt #deeplearning #machinelearning #bert #gpt 75 years of Language Models](https://i.ytimg.com/vi/QQIwfpOY-qA/mqdefault.jpg)
![LLM Self-Taught Reasoning - Explained!
Lets talk about how LLMs can better learn to do Arithmetic using Self-Taught Reasoning (STaR).
RESOURCES
[1] Chain-of-Thought Prompting elicits reasoning in LLMs: https://arxiv.org/pdf/2201.11903
[2] Self-Taught Reasoner : https://arxiv.org/pdf/2203.14465
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
1:13 Pass 1: Why STaR?
5:36 Quiz Time 1
6:38 Pass 2: What and How STaR?
10:30 Quiz Time 2
11:40 Pass 3: Performance & Limitations
15:17 Quiz Time 3
16:29 Summary LLM Self-Taught Reasoning - Explained!](https://i.ytimg.com/vi/QRP70U6V6Lc/mqdefault.jpg)