Uploaded July 2026 | Updated November 2026, 2 hours ago
Let's answer this question with a story that talks about convolution networks, transformers, scalability and data!
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 π] Computer Vision Playlist: youtube.com/playlist?list=PLTl9hO2Oobd_vXwWZLI9_dgJns3nR_ZyW
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
CHAPTERS
00:00 Why Convolution Networks are good with images
01:46 Transformers
02:53 BERT, GPT for Pretraining-Finetuning
03:43 Scaling Laws
04:21 Vision Transformer
05:45 Foundation Models
07:53 Answering the Question
Let's answer this question with a story that talks about convolution networks, transformers, scalability and data!
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 π] Computer Vision Playlist: youtube.com/playlist?list=PLTl9hO2Oobd_vXwWZLI9_dgJns3nR_ZyW
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
CHAPTERS
00:00 Why Convolution Networks are good with images
01:46 Transformers
02:53 BERT, GPT for Pretraining-Finetuning
03:43 Scaling Laws
04:21 Vision Transformer
05:45 Foundation Models
07:53 Answering the Question
![Sentence Embeddings - EXPLAINED!
Medium Article for this video: https://medium.com/towards-data-science/ais-sentence-embeddings-demystified-7c9cce145dd2
SPONSOR
Get 20% off and be apart of a Premium Software Engineering Community for career advice and guidance: https://www.jointaro.com/r/ajayh486/
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
DETAILED VIDEOS ON TOPICS DISCUSSED
[1 π΄] Curse of Dimensionality: https://youtu.be/L9eNxU-9jBQ
[2 π΄] Time Delay Neural Networks +: Dynamic Convolution Neural Networks: https://youtu.be/AGWieLbom_g
[3 π΄] Word2Vec video: https://youtu.be/9S0-OC4LFNo
[4 π΄] LSTM Video: https://www.youtube.com/watch?v=QciIcRxJvsM
[5 π΄] Transformer Video: https://www.youtube.com/watch?v=TQQlZhbC5ps
[6 π΄] BERT video: https://www.youtube.com/watch?v=xI0HHN5XKDo
[7 π΄] Sentence Transformers video: https://youtu.be/O3xbVmpdJwU
[8 π΄] ChatGPT video: https://youtu.be/NpmnWgQgcsA
PLAYLISTS FROM MY CHANNEL
β Transformers from scratch playlist: https://www.youtube.com/watch?v=QCJQG4DuHT0&list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist of all other videos: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Transformer Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Sentence Embeddings - EXPLAINED!](https://i.ytimg.com/vi/EcuVZzUiHMY/mqdefault.jpg)
![CLIP - Explained!
In this video, we take a look at CLIP (contrastive language image pretraining). What is it? Why do we have it? How does it look? And some code!
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Main Paper: https://openai.com/index/clip/
[2 π] Slides: https://link.excalidraw.com/p/readonly/STU1Z0GcInkQNvA8naKM
[3 π] Code: https://github.com/ajhalthor/computer-vision-101/tree/main/CLIP
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is CLIP?
00:51 How is CLIP Trained?
04:23 Zero-shot Inference
06:30 Why CLIP?
07:25 Code to illustrate CLIPs rich encoding
09:20 Performance
09:45 Linear Probing
11:06 Quiz Time
12:04 Summary CLIP - Explained!](https://i.ytimg.com/vi/FCDKn-vpn_o/mqdefault.jpg)
![How did AI Learn to Segment Anything?
How did AI Learn to Segment Anything? There is a story behind this.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Code for Felzenszwalb Segmentation: https://github.com/ajhalthor/computer-vision-101/blob/main/graph_based_image_segmentation.ipynb
[2 π] Felzenszwalb paper: https://cs.brown.edu/people/pfelzens/papers/seg-ijcv.pdf?utm_source=chatgpt.com
[3 π] AlexNet paper: https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
[4 π] Fully Convolution Network paper: https://arxiv.org/pdf/1411.4038
[5 π] U-Net paper: https://arxiv.org/pdf/1505.04597
[6 π] DeepLab paper: https://arxiv.org/pdf/1606.00915
[7 π] Mask R-CNN paper: https://arxiv.org/pdf/1703.06870
[8 π] Transformer paper: https://arxiv.org/pdf/1706.03762
[9 π ] MaskFormer paper: https://arxiv.org/pdf/2107.06278
[10 π ] SAM paper: https://arxiv.org/pdf/2304.02643
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow How did AI Learn to Segment Anything?](https://i.ytimg.com/vi/FGtj_1lW81M/mqdefault.jpg)
![YOLO - Explained!
In this video, we take a look the YOLO (V1) network. What is it? Why and how does it work?
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides used in the video: https://link.excalidraw.com/p/readonly/paC99NHwy4hi6jfJfUVl
[2 π] Architecture diagram: https://github.com/ajhalthor/computer-vision-101/tree/main/yolo
[3 π] Main paper of the video: https://arxiv.org/pdf/1506.02640
[4 π] RCNN video: https://youtu.be/ZytVRaNE4cA?si=jnBfm_vuh_9wwZau
[5 π ] Fast RCNN video: https://youtu.be/rYLD9RLCqGo?si=qFzm35uGulhXwoja
[6 π ] Faster RCNN video:
[7 π ] Great video by original creator: https://www.youtube.com/watch?v=NM6lrxy0bxs
[8 π ] Slides for that video: https://docs.google.com/presentation/d/1kAa7NOamBt4calBU9iHgT8a86RRHz9Yz2oh4-GTdX6M/edit?slide=id.g14f95ab154_0_1#slide=id.g14f95ab154_0_1
[9 π ] Interactive colab notebook to upload images: https://colab.research.google.com/drive/1WloX6-FJCSgEj3ovosOM4XwxdgggdAW7?usp=sharing#scrollTo=Nmp46gTZBMQM
[10 π ] pytorch implementation by explainingAI: https://github.com/explainingai-code/Yolov1-PyTorch
[11 π ] Another reimplementation in pytorch: https://github.com/motokimura/yolo_v1_pytorch/tree/master
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is YOLO?
00:45 Why YOLO and its advantages over R-CNN
05:29 Architecture
08:44 Why is output tensor 7 x 7x 30?
11:24 Training YOLO
14:56 Loss function
19:38 Inference of YOLO
20:28 Quiz Time
21:24 Summary YOLO - Explained!](https://i.ytimg.com/vi/G7oGWh8PZAE/mqdefault.jpg)


![Word Embeddings - EXPLAINED!
Lets talk word embeddings in NLP!
SPONSOR
Get 20% off and be apart of a Premium Software Engineering Community for career advice and guidance: https://www.jointaro.com/r/ajayh486/
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] A Neural Probabilistic Language Model (Bengio et al., 2003): https://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf
[2 π] Fast Semantic Extraction Using a Novel Neural Network Architecture (Collobert et al., 2008): https://aclanthology.org/P07-1071.pdf
[3 π] Word2Vec: https://arxiv.org/pdf/1301.3781.pdf
[4 π] ELMo: https://arxiv.org/abs/1802.05365
[5 π] Transformer Paper: https://arxiv.org/pdf/1706.03762.pdf
[6 π] BERT video: https://www.youtube.com/watch?v=xI0HHN5XKDo
[7 π] BERT Paper: https://arxiv.org/abs/1810.04805
[8 π] ChatGPT: https://openai.com/blog/chatgpt
PLAYLISTS FROM MY CHANNEL
β Transformers from scratch playlist: https://www.youtube.com/watch?v=QCJQG4DuHT0&list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β ChatGPT Playlist of all other videos: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Transformer Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD Word Embeddings - EXPLAINED!](https://i.ytimg.com/vi/GmXkCCa4eVA/mqdefault.jpg)


![LLM (Parameter Efficient) Fine Tuning - Explained!
Parameter efficient fine tuning is increasingly important in NLP and genAI. Lets talk about it.
RESOURCES
[1 π] RNNs were the SOTA for sequence tasks: https://arxiv.org/pdf/1409.0473
[2 π] Then transformers came on the scene: https://arxiv.org/pdf/1706.03762
[3 π] Pretraining and Finetuning architectures like BERT came along: https://arxiv.org/pdf/1810.04805
[4 π] But LLMs are huge: https://informationisbeautiful.net/visualizations/the-rise-of-generative-ai-large-language-models-llms-like-chatgpt/
[5 π] Few shot learning by GPT-3 tries to address the issue: https://arxiv.org/pdf/2005.14165
[6 π] Parameter Efficient Transfer Learning reduces the trainable parameters via additive adapters (the first PEFT technique): https://arxiv.org/pdf/1902.00751
[7 π] Since 2019, there have been many PEFT techniques introduced: https://arxiv.org/pdf/2312.12148
[8 π] Other notable techniques include prefix-tuning: https://arxiv.org/pdf/2101.00190
[9 π] And LoRA: https://arxiv.org/pdf/2106.09685
[10 π] And a quantized version of LoRA called QLoRA: https://arxiv.org/pdf/2305.14314
[11 π] We see these adapters in use in LLMs today like Llama: https://arxiv.org/pdf/2303.16199
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
CHAPTERS
0:00 Introduction
1:00 Pass 1: What & Why PEFT
6:27 Quiz 1
7:26 Pass 2: Details
16:20 Quiz 2
17:11 Pass 3: Performance Evaluation
20:49 Quiz 3
21:43 Summary
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow LLM (Parameter Efficient) Fine Tuning - Explained!](https://i.ytimg.com/vi/HcVtpLAGMXo/mqdefault.jpg)
![Vision Transformers - Explained!
In this video, we take a look at Vision Transformers (ViT). What is it? Why do we have it? How do we pretrain and fine tune it?
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides: https://link.excalidraw.com/p/readonly/6S2vdCqfNqdfLTeMY3UB
[2 π] Paper that introduced Vision Transformers: https://arxiv.org/pdf/2010.11929
[3 π] Paper that introduced transformers: https://arxiv.org/pdf/1706.03762
[4 π] Playlist of Transformers from scratch: https://youtu.be/QCJQG4DuHT0?si=UllVN6odQKC-nsvb
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is ViT?
01:41 Why do we have ViTs?
09:50 Pretraining
15:13 Fine tuning
19:22 Quiz Time
20:19 Summary Vision Transformers - Explained!](https://i.ytimg.com/vi/Hnsrm1ezI3g/mqdefault.jpg)