Swin transformer - Explained! @CodeEmporium
Swin transformer - Explained!  @CodeEmporium
Uploaded January 2026 | Updated November 2026, 7 hours ago
In this video, we take a look at Swin Transformers. What is it? Why do we have it? How does it look?

ABOUT ME
β­• Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
πŸ“š Medium Blog: medium.com/@dataemporium
πŸ’» Github: github.com/ajhalthor
πŸ‘” LinkedIn: linkedin.com/in/ajay-halthor-477974bb

RESOURCES
[1 πŸ“š] Main Paper: arxiv.org/pdf/2103.14030
[2 πŸ“š] Slides: link.excalidraw.com/p/readonly/GDnU1EEBGfAyUoEtVyj8
[3 πŸ“š] Feature Pyramid Networks: youtu.be/i4GKvPGoGxY?si=fgWUV1DYQH3YeU-6
[4 πŸ“š] Playlist of Transformers from scratch: youtu.be/QCJQG4DuHT0?si=UllVN6odQKC-nsvb
[5 πŸ“š] Faster R-CNN: youtu.be/ws0nlxCWWI8?si=om9yCa-mKWxTtFmQ
[6 πŸ“š] DETR: youtu.be/r3lDNWYDGF4?si=N4XehrgljW0A7XPQ

PLAYLISTS FROM MY CHANNEL
β­• Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β­• Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β­• ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β­• Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β­• The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β­• Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β­• Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD


MATH COURSES (7 day free trial)
πŸ“• Mathematics for Machine Learning: imp.i384100.net/MathML
πŸ“• Calculus: imp.i384100.net/Calculus
πŸ“• Statistics for Data Science: imp.i384100.net/AdvancedStatistics
πŸ“• Bayesian Statistics: imp.i384100.net/BayesianStatistics
πŸ“• Linear Algebra: imp.i384100.net/LinearAlgebra
πŸ“• Probability: imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
πŸ“• ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
πŸ“• Python for Everybody: imp.i384100.net/python
πŸ“• MLOps Course: imp.i384100.net/MLOps
πŸ“• Natural Language Processing (NLP): imp.i384100.net/NLP
πŸ“• Machine Learning in Production: imp.i384100.net/MLProduction
πŸ“• Data Science Specialization: imp.i384100.net/DataScience
πŸ“• Tensorflow: imp.i384100.net/Tensorflow

CHAPTERS
00:00 What is the Swin Transformer?
01:30 Historical context to understand why Swin Transformers exist
04:45 Problems with vanilla transformer architectures with images
08:23 Swin Transformer architecuture at a high level
09:40 What is the β€œSwin Transformer Block”
10:14 Deep dive into the Swin Transformer block architecture
11:06 Windowed-Multi-head Self Attention
16:10 Shifted Window Multi-head self attention
21:43 Patch Merging
22:36 Swin Transformer + Feature Pyramid Network as backbone
23:46 Performance
24:51 Quiz Time
26:05 Summary
Swin transformer - Explained!What are RNNs?Embeddings - EXPLAINED!Optimizers in Neural Networks - EXPLAINED!Vector to Sequence Recurrent Neural Network #deeplearning #machinelearningWhat was the first language model?NLP - EXPLAINED!Why Parametric form is important in Linear Regression #machinelearningInformer Encoder architecture - EXPLAINED!Transformer training at a glanceWhat are self attention vectors?BERT Pretraining in 60 seconds #deeplearning #machinelearning
CodeEmporium |

Swin transformer - Explained!

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER