Informer attention code -  FROM SCRATCH! @CodeEmporium
Informer attention code -  FROM SCRATCH!  @CodeEmporium
Uploaded June 2024 | Updated November 2026, 3 hours ago
In this video, we code the prob sparse attention and compare it to time series attention


ABOUT ME
β­• Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
πŸ“š Medium Blog: medium.com/@dataemporium
πŸ’» Github: github.com/ajhalthor
πŸ‘” LinkedIn: linkedin.com/in/ajay-halthor-477974bb

RESOURCES
[1] Main repo: github.com/zhouhaoyi/Informer2020/blob/main/models/attn.py
[2] Code for the colab notebook: github.com/ajhalthor/Informer/tree/main

PLAYLISTS FROM MY CHANNEL
β­• Deep Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β­• Natural Language Processing 101: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β­• Reinforcement Learning 101: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
β­• Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β­• ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ


MATH COURSES (7 day free trial)
πŸ“• Mathematics for Machine Learning: imp.i384100.net/MathML
πŸ“• Calculus: imp.i384100.net/Calculus
πŸ“• Statistics for Data Science: imp.i384100.net/AdvancedStatistics
πŸ“• Bayesian Statistics: imp.i384100.net/BayesianStatistics
πŸ“• Linear Algebra: imp.i384100.net/LinearAlgebra
πŸ“• Probability: imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
πŸ“• ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
πŸ“• Python for Everybody: imp.i384100.net/python
πŸ“• MLOps Course: imp.i384100.net/MLOps
πŸ“• Natural Language Processing (NLP): imp.i384100.net/NLP
πŸ“• Machine Learning in Production: imp.i384100.net/MLProduction
πŸ“• Data Science Specialization: imp.i384100.net/DataScience
πŸ“• Tensorflow: imp.i384100.net/Tensorflow
Informer attention code -  FROM SCRATCH!History of AI and speech processingWhy Minibatch Gradient Descent in Transformers?Where did convolution networks come from?Knowledge Distillation in Neural Networks - Explained!Why do CNNs look like THIS?Why Do Transformers Look Like This?LoRA - Explained!Decoder training with transformersMasked RCNN - Explained!  #deeplearning #machinelearningBuilding your first Neural NetworkLSTM construction explained #deeplearning #machinelearning
CodeEmporium |

Informer attention code - FROM SCRATCH!

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER