Uploaded August 2023 | Updated November 2026, 2 hours ago
ABOUT ME
⭕ Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
📚 Medium Blog: medium.com/@dataemporium
💻 Github: github.com/ajhalthor
👔 LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 🔴] Llama 1 dissertation: arxiv.org/pdf/2302.13971.pdf
[2 🔴] Llama 2 dissertation: scontent-lax3-1.xx.fbcdn.net/v/t39.2365-6/10000000_662098952474184_2584067087619170692_n.pdf?_nc_cat=105&ccb=1-7&_nc_sid=3c67a6&_nc_ohc=O3eQj9LEMfQAX_IC7oO&_nc_ht=scontent-lax3-1.xx&oh=00_AfDihQ7maFg_ebWGZCxpt1ZYmSfYupRr1HJMyexxrC7nwg&oe=64DA167F
[3 🔴] Llama code: github.com/facebookresearch/llama/blob/main/llama/model.py
[4 🔴] Where I got the decoder only transformer architecture: ai.stackexchange.com/questions/40179/how-does-the-decoder-only-transformer-architecture-work
[5 🔴] Huggingface models on Llama that you can use for inference: huggingface.co/models?search=llama2
[6 🔴] Llama vs Alpaca: sapling.ai/llm/alpaca-vs-llama2
[7 🔴] Llama2 file using Qlora: colab.research.google.com/drive/12dVqXZMIVxGI0uutU6HG9RWbWPXL3vts?usp=sharing#scrollTo=C2EgqEPDQ8v6
[8 🔴] @1littlecoder 's video describing Qlora and how you can fine tune llama: youtube.com/watch?v=eeM6V5aPjhk
[9 🔴] Autotrain repo for 1 line training: github.com/huggingface/autotrain-advanced
[10 🔴] Video describing on how to use Autotrain (@abhishekkrthakur ) : youtube.com/watch?v=3fsn19OI_C8
PLAYLISTS FROM MY CHANNEL
⭕ Transformers from scratch playlist: youtube.com/watch?v=QCJQG4DuHT0&list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
⭕ ChatGPT Playlist of all other videos: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
⭕ Transformer Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
⭕ Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
⭕ The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
⭕ Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
⭕ Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: imp.i384100.net/MathML
📕 Calculus: imp.i384100.net/Calculus
📕 Statistics for Data Science: imp.i384100.net/AdvancedStatistics
📕 Bayesian Statistics: imp.i384100.net/BayesianStatistics
📕 Linear Algebra: imp.i384100.net/LinearAlgebra
📕 Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
📕 Python for Everybody: imp.i384100.net/python
📕 MLOps Course: imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): imp.i384100.net/NLP
📕 Machine Learning in Production: imp.i384100.net/MLProduction
📕 Data Science Specialization: imp.i384100.net/DataScience
📕 Tensorflow: imp.i384100.net/Tensorflow
#chatgpt #deeplearning #machinelearning #bert #gpt
ABOUT ME
⭕ Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
📚 Medium Blog: medium.com/@dataemporium
💻 Github: github.com/ajhalthor
👔 LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 🔴] Llama 1 dissertation: arxiv.org/pdf/2302.13971.pdf
[2 🔴] Llama 2 dissertation: scontent-lax3-1.xx.fbcdn.net/v/t39.2365-6/10000000_662098952474184_2584067087619170692_n.pdf?_nc_cat=105&ccb=1-7&_nc_sid=3c67a6&_nc_ohc=O3eQj9LEMfQAX_IC7oO&_nc_ht=scontent-lax3-1.xx&oh=00_AfDihQ7maFg_ebWGZCxpt1ZYmSfYupRr1HJMyexxrC7nwg&oe=64DA167F
[3 🔴] Llama code: github.com/facebookresearch/llama/blob/main/llama/model.py
[4 🔴] Where I got the decoder only transformer architecture: ai.stackexchange.com/questions/40179/how-does-the-decoder-only-transformer-architecture-work
[5 🔴] Huggingface models on Llama that you can use for inference: huggingface.co/models?search=llama2
[6 🔴] Llama vs Alpaca: sapling.ai/llm/alpaca-vs-llama2
[7 🔴] Llama2 file using Qlora: colab.research.google.com/drive/12dVqXZMIVxGI0uutU6HG9RWbWPXL3vts?usp=sharing#scrollTo=C2EgqEPDQ8v6
[8 🔴] @1littlecoder 's video describing Qlora and how you can fine tune llama: youtube.com/watch?v=eeM6V5aPjhk
[9 🔴] Autotrain repo for 1 line training: github.com/huggingface/autotrain-advanced
[10 🔴] Video describing on how to use Autotrain (@abhishekkrthakur ) : youtube.com/watch?v=3fsn19OI_C8
PLAYLISTS FROM MY CHANNEL
⭕ Transformers from scratch playlist: youtube.com/watch?v=QCJQG4DuHT0&list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
⭕ ChatGPT Playlist of all other videos: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
⭕ Transformer Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
⭕ Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
⭕ The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
⭕ Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
⭕ Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: imp.i384100.net/MathML
📕 Calculus: imp.i384100.net/Calculus
📕 Statistics for Data Science: imp.i384100.net/AdvancedStatistics
📕 Bayesian Statistics: imp.i384100.net/BayesianStatistics
📕 Linear Algebra: imp.i384100.net/LinearAlgebra
📕 Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
📕 Python for Everybody: imp.i384100.net/python
📕 MLOps Course: imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): imp.i384100.net/NLP
📕 Machine Learning in Production: imp.i384100.net/MLProduction
📕 Data Science Specialization: imp.i384100.net/DataScience
📕 Tensorflow: imp.i384100.net/Tensorflow
#chatgpt #deeplearning #machinelearning #bert #gpt

![Informer attention Architecture - FROM SCRATCH!
Here is the architecture of probsparse attention for time series transformers.
ABOUT ME
⭕ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
📚 Medium Blog: https://medium.com/@dataemporium
💻 Github: https://github.com/ajhalthor
👔 LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Main paper that introduced the Informer: https://arxiv.org/pdf/2012.07436
PLAYLISTS FROM MY CHANNEL
⭕ Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
⭕ Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
⭕ Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
⭕ Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
⭕ ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: https://imp.i384100.net/MathML
📕 Calculus: https://imp.i384100.net/Calculus
📕 Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
📕 Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
📕 Linear Algebra: https://imp.i384100.net/LinearAlgebra
📕 Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
📕 Python for Everybody: https://imp.i384100.net/python
📕 MLOps Course: https://imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): https://imp.i384100.net/NLP
📕 Machine Learning in Production: https://imp.i384100.net/MLProduction
📕 Data Science Specialization: https://imp.i384100.net/DataScience
📕 Tensorflow: https://imp.i384100.net/Tensorflow Informer attention Architecture - FROM SCRATCH!](https://i.ytimg.com/vi/zcBA2KhTwMg/mqdefault.jpg)