CNNs became Transformers... @CodeEmporium
CNNs became Transformers...  @CodeEmporium
Uploaded September 2026 | Updated November 2026, 1 day ago
Can we transform a Convolution Neural Network into a Transformer?

ABOUT ME
β­• Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
πŸ“š Medium Blog: medium.com/@dataemporium
πŸ’» Github: github.com/ajhalthor
πŸ‘” LinkedIn: linkedin.com/in/ajay-halthor-477974bb

RESOURCES
[1 πŸ“š] ResNet paper: arxiv.org/pdf/1512.03385
[2 πŸ“š] Transformer Paper: arxiv.org/pdf/1706.03762
[3 πŸ“š] Vision Transformer paper: arxiv.org/pdf/2010.11929
[4 πŸ“š] Swin Transformer paper: arxiv.org/pdf/2103.14030
[5 πŸ“š] ConvNeXt paper: arxiv.org/pdf/2201.03545
[6 πŸ“š] Transformer Architecture diagram: raw.githubusercontent.com/ajhalthor/Transformer-Neural-Network/refs/heads/main/Transformer_Architecture_complete.png
[7 πŸ“š] Depthwise Separable Convolution (from MobileNet paper): arxiv.org/pdf/1704.04861

OTHERS (Material used in video)
[1 πŸ“š] Explainable AI: Visualizing Attention in Transformers: comet.com/site/blog/explainable-ai-for-transformers
[2 πŸ“š] LightlyAI: Vision Transformers: lightly.ai/blog/vision-transformers-vit


PLAYLISTS FROM MY CHANNEL
β­• Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β­• Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
β­• ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β­• Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β­• The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β­• Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β­• Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD


MATH COURSES (7 day free trial)
πŸ“• Mathematics for Machine Learning: imp.i384100.net/MathML
πŸ“• Calculus: imp.i384100.net/Calculus
πŸ“• Statistics for Data Science: imp.i384100.net/AdvancedStatistics
πŸ“• Bayesian Statistics: imp.i384100.net/BayesianStatistics
πŸ“• Linear Algebra: imp.i384100.net/LinearAlgebra
πŸ“• Probability: imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
πŸ“• ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
πŸ“• Python for Everybody: imp.i384100.net/python
πŸ“• MLOps Course: imp.i384100.net/MLOps
πŸ“• Natural Language Processing (NLP): imp.i384100.net/NLP
πŸ“• Machine Learning in Production: imp.i384100.net/MLProduction
πŸ“• Data Science Specialization: imp.i384100.net/DataScience
πŸ“• Tensorflow: imp.i384100.net/Tensorflow

CHAPTERS
00:00 The Traditional CNN
00:50 Then there were Transformers
02:10 They got efficient for images
02:56 Are CNNs dead? Let's change that
03:50 Fix layer ratios
04:41 "Patchify" image with Convolutions
05:20 Use Depthwise and Pointwise Convolutions
06:20 Invert the CNN "bottleneck"
07:50 Use Larger Kernels
08:50 Changes to "Transformerize" the CNN
09:59 Transformers vs the new CNN
CNNs became Transformers...Informer: Complete Code from scratch!Position Encoding in Transformer Neural NetworkTransformers process data in parallelDid Transformers Kill YOLO?Reinforcement Learning: from Atari Games to Robotic WalkingFully Convolution Neural Networks Explained #deeplearning #machinelearningTypes of Time series models #deeplearning #machinelearningMask R-CNN - Explained!Batch Normalization in neural networks - EXPLAINED!Visualizing convolution networksThis Model fixed Object Detection’s Biggest Training Problem!
CodeEmporium |

CNNs became Transformers...

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER