Uploaded April 2026 | Updated November 2026, 4 hours ago
In this video, we take a look at a core component of DALL-E text-to-image generation: discrete autoencoders. What is it? Why do we have it? How does it look? We specifically looks at vanilla Autoencoders, Variational Auto-encoders and VQ-VAEs.
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 π] Slides: link.excalidraw.com/p/readonly/GElfVd51jvXhYuQ6yjns
[2 π] Paper that suggests Autoencoders address βback propagation without a teacherβ: https://proceedings.mlr.press/v27/baldi12a/baldi12a.pdf
[3 π] Early paper on auto encoders that compared performance vs PCA (2006): https://www.cs.toronto.edu/~hinton/absps/science.pdf
[4 π] 2013 VAE paper: arxiv.org/abs/1312.6114?utm_source=chatgpt.com
[5 π] 2017 VQ-VAE paper: papers.nips.cc/paper_files/paper/2017/file/7a98af17e63a0ac09ce2e96d03992fbc-Paper.pdf
[6 π] 2017 paper on discrete variational auto encoders: arxiv.org/pdf/1609.02200
[7 π] A digestible, yet formal introduction to discrete VAE: arxiv.org/pdf/2505.10344
[8 π] Paper that shows how to recover from posterior collapse: openreview.net/pdf/729562a11b8fe6b0af7244d73dea98ec6c5f8376.pdf?utm_source=chatgpt.com
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is DALL-E?
01:08 Autoencoders
02:59 What are Variational Autoencoders?
03:22 How VAE is better suited for generation than AE.
05:18 VAE structure and forward pass
07:09 Reparameterization trick
12:09 VAE loss function
13:49 VAE inference
14:44 What is VQ-VAE, forward pass, loss
18:06 Straight through estimator
20:08 Posterior Collapse
23:52 Discrete representations
25:00 Compatibility with sequence models (and DALL-E)
25:56 Quiz Time
26:52 Summary
In this video, we take a look at a core component of DALL-E text-to-image generation: discrete autoencoders. What is it? Why do we have it? How does it look? We specifically looks at vanilla Autoencoders, Variational Auto-encoders and VQ-VAEs.
ABOUT ME
β Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: medium.com/@dataemporium
π» Github: github.com/ajhalthor
π LinkedIn: linkedin.com/in/ajay-halthor-477974bb
RESOURCES
[1 π] Slides: link.excalidraw.com/p/readonly/GElfVd51jvXhYuQ6yjns
[2 π] Paper that suggests Autoencoders address βback propagation without a teacherβ: https://proceedings.mlr.press/v27/baldi12a/baldi12a.pdf
[3 π] Early paper on auto encoders that compared performance vs PCA (2006): https://www.cs.toronto.edu/~hinton/absps/science.pdf
[4 π] 2013 VAE paper: arxiv.org/abs/1312.6114?utm_source=chatgpt.com
[5 π] 2017 VQ-VAE paper: papers.nips.cc/paper_files/paper/2017/file/7a98af17e63a0ac09ce2e96d03992fbc-Paper.pdf
[6 π] 2017 paper on discrete variational auto encoders: arxiv.org/pdf/1609.02200
[7 π] A digestible, yet formal introduction to discrete VAE: arxiv.org/pdf/2505.10344
[8 π] Paper that shows how to recover from posterior collapse: openreview.net/pdf/729562a11b8fe6b0af7244d73dea98ec6c5f8376.pdf?utm_source=chatgpt.com
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: imp.i384100.net/MathML
π Calculus: imp.i384100.net/Calculus
π Statistics for Data Science: imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: imp.i384100.net/BayesianStatistics
π Linear Algebra: imp.i384100.net/LinearAlgebra
π Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: imp.i384100.net/Deep-Learning
π Python for Everybody: imp.i384100.net/python
π MLOps Course: imp.i384100.net/MLOps
π Natural Language Processing (NLP): imp.i384100.net/NLP
π Machine Learning in Production: imp.i384100.net/MLProduction
π Data Science Specialization: imp.i384100.net/DataScience
π Tensorflow: imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is DALL-E?
01:08 Autoencoders
02:59 What are Variational Autoencoders?
03:22 How VAE is better suited for generation than AE.
05:18 VAE structure and forward pass
07:09 Reparameterization trick
12:09 VAE loss function
13:49 VAE inference
14:44 What is VQ-VAE, forward pass, loss
18:06 Straight through estimator
20:08 Posterior Collapse
23:52 Discrete representations
25:00 Compatibility with sequence models (and DALL-E)
25:56 Quiz Time
26:52 Summary
![Boltzmann Machine - Explained!
Lets talk about Boltzmann Machines
RESOURCES
[1 π] Main paper: https://web.archive.org/web/20110718022336/http://learning.cs.toronto.edu/~hinton/absps/cogscibm.pdf
[2 π] Quick summary: https://www.cs.toronto.edu/~hinton/csc321/readings/boltz321.pdf
[3 π] Geoffry Hintonβs lectures (From 11 c): https://www.youtube.com/watch?v=IP3W7cI01VY&list=PLiPvV5TNogxKKwvKb1RKwkq2hm7ZvpHz0&index=11
[4 π] Another easier to understand summary : https://www.engati.com/glossary/boltzmann-machine
[5 π] University of Toronto :https://www.cs.toronto.edu/~rgrosse/courses/csc321_2017/slides/lec19.pdf
[6 π] Rithvikmath has amazing videos on Gibb sampling (used here to get sample states from the model and use in our learning procedure) : https://www.youtube.com/watch?v=MNHIbOqH3sk
[7 π] Boltzmann Distribution: https://en.wikipedia.org/wiki/Boltzmann_distribution
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
0:13 Pass 1: What is Boltzmann Machine?
4:03 Quiz 1
5:07 Pass 2: How does Boltzmann Machine work?
7:00 How the network learns the probability distribution?
14:22 Quiz 2
16:00 Energy landscape
15:19 Why is it Boltzmann machine?
16:28 Stochastic neuron probability function
19:50 How to derive the learning rule
20:28 How long does training happen?
21:24 Quiz 3
22:16 Summary Boltzmann Machine - Explained!](https://i.ytimg.com/vi/Y8cBT_Qt_fQ/mqdefault.jpg)


![Reinforcement Learning: on-policy vs off-policy algorithms
Lets talk about on-policy vs off-policy algorithms in reinforcement learning
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Reinforcement Learning book: http://incompleteideas.net/book/RLbook2020.pdf
[2] Paradigms of ML: https://idapgroup.com/blog/types-of-machine-learning-out-there/
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Reinforcement Learning: on-policy vs off-policy algorithms](https://i.ytimg.com/vi/YUKUXoUg3Nc/mqdefault.jpg)
![Evolution of Neural Networks: Zero to Hero
RESOURCES
[1 π ] A logical calculus of the ideas immanent in neuron activity (McCulloch-Pitts artificial neuron): https://www.cs.cmu.edu/~./epxing/Class/10715/reading/McCulloch.and.Pitts.pdf
[2 π] The perceptron: A probabilistic model for information storage and organization in the brain: https://www.ling.upenn.edu/courses/cogs501/Rosenblatt1958.pdf
[3 π] An adaptive βAdalineβ neuron using chemical βmemistorsβ: https://isl.stanford.edu/~widrow/papers/t1960anadaptive.pdf
[4 π] Neural networks and physical systems with emergent collective computational abilities (Hopfield nets): https://pmc.ncbi.nlm.nih.gov/articles/instance/346238/pdf/pnas00447-0135.pdf
[5 π] A learning algorithm for Boltzmann Machines: https://web.archive.org/web/20110718022336/http://learning.cs.toronto.edu/~hinton/absps/cogscibm.pdf
[6 π] Learning representations by back propagating errors: http://www.cs.utoronto.ca/~hinton/absps/naturebp.pdf
SUPPLEMENTAL RESOURCES:
[1 π] Action potential - a nice video explanation: https://www.youtube.com/watch?v=BbUcWbtVjT4
[2 π ] Nice notes with MP neurons: https://marlin.life.utsa.edu/mcculloch-and-pitts.html
[3 π] Synaptic Plasticity: https://www.youtube.com/watch?v wakk5Iwqj8
[4 π ] Cell assembly in hebbian learning: http://www.scholarpedia.org/article/Cell_assemblies
[5 π] Perceptron demo: https://sergedesmedt.github.io/MathOfNeuralNetworks/PerceptronLearningMath.html#learn_perceptron_learningrule_animation
[6 π] Perceptron convergence theorem explained: https://www.youtube.com/watch?v=kObhWlqIeD8&t=250s
[7 π] A symbolic analysis of relay and switching circuits: https://www.cs.virginia.edu/~evans/greatworks/shannon38.pdf
[8 π ] Geoffrey Hintonβs lecture on Hopfield Nets: https://www.youtube.com/watch?v=IP3W7cI01VY&list=PLiPvV5TNogxKKwvKb1RKwkq2hm7ZvpHz0&index=11
[9 π] Gibbs sampling used in learning in Boltzmann machines (video by Rithvikmath): https://www.youtube.com/watch?v=MNHIbOqH3sk
[10 π] Lecture notes on the mathematics behind Boltzmann machines: https://www.cs.toronto.edu/~rgrosse/courses/csc321_2017/slides/lec19.pdf
[11 π] Cauchyβs paper on gradient descent: http://www.kurims.kyoto-u.ac.jp/EMIS/journals/DMJDMV/vol-ismp/40_lemarechal-claude.pdf
[12 π] Hinton explaining the mechanics of back propagation introduced by Rumelhart, Williams and himself: https://www.youtube.com/watch?v=VCT1N0EsGj0
[13 π ] Reverse mode automatic differentiation (like back propagation): https://rufflewind.com/2016-12-30/reverse-mode-automatic-differentiation
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
0:00 Introduction
00:25 1. The artificial neuron
19:46 2. Perceptron
42:12 3. ADALINE
59:01 4. Hopfield Networks
1:18:57 5. Boltzmann Machines
1:42:20 6. Multilayer Perceptron
1:55:25 7. Evolution of Back propagation
2:22:27 Conclusion Evolution of Neural Networks: Zero to Hero](https://i.ytimg.com/vi/Z-numtJvK2o/mqdefault.jpg)

![R-CNN - Explained!
In this video, we take a look at R-CNN (regions with convolution features). We see how training and inference occurs.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides used in the video: https://link.excalidraw.com/p/readonly/bzjf249TGpqTNxjU7k3d
[2 π] Main paper that introduced R-CNN: https://arxiv.org/pdf/1311.2524
[3 π] My video on how to generate region proposals using βselective searchβ with code: https://youtu.be/RDdLUm4gLec?si=Tdsp8b6TjLEwLhtZ
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 Overview
01:49 Stage 1: Region proposal generation
04:11 Stage 2: Feature extraction with Convolution network
12:45 Stage 3: SVM classification to determine object in each region proposal
15:43 Quiz Time
16:48 Summary R-CNN - Explained!](https://i.ytimg.com/vi/ZytVRaNE4cA/mqdefault.jpg)

![Vision: Structure of the eye - Explained!
Lets take a look at the structure of the human eye. This is the inspiration for modern computer vision today.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides: https://link.excalidraw.com/p/readonly/9J2Eflz4aM5rNgjPOz8X
[2 π] Khan academy structure of eye: https://www.youtube.com/watch?v=7HGxjs_aYyg
[3 π] If a point sized image is formed on a retina, why dont we see the world as points? https://qr.ae/pAIwGJ
[34π] Diagram descriptions of the eye: https://www.reddit.com/r/Mcat/comments/15p9r26/depictions_of_eye_optics_are_misleading_tips_to/?rdt=39195
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Vision: Structure of the eye - Explained!](https://i.ytimg.com/vi/_Kf8NprzNkw/mqdefault.jpg)
![Informer: Time series Transformer - EXPLAINED!
Lets talk about a time series transformer: Informer.
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Main paper that introduced the Informer: https://arxiv.org/pdf/2012.07436
PLAYLISTS FROM MY CHANNEL
β Deep Learning 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU
β Natural Language Processing 101: https://www.youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β Reinforcement Learning 101: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing 101: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow Informer: Time series Transformer - EXPLAINED!](https://i.ytimg.com/vi/aETHYkoJeNY/mqdefault.jpg)
![Pointwise Convolutions - EXPLAINED (with code)
In this video, we take a look 1x1 convolutions (point wise convolutions) and demonstrate what they are, why they are useful, architecture diagrams and PyTorch code!
ABOUT ME
β Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
π Medium Blog: https://medium.com/@dataemporium
π» Github: https://github.com/ajhalthor
π LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1 π] Slides used in the video: https://link.excalidraw.com/p/readonly/7aEsWmuZNQK4SE2IHzWn
[2 π] Main paper of the video that introduces 1x1 convolutions: https://arxiv.org/pdf/1312.4400
[3 π] Code + Diagrams used in the video: https://github.com/ajhalthor/computer-vision-101/tree/main/pointwise_convolution
[4 π] Paper that visualizes what each layer of the convolution networks learn: https://arxiv.org/pdf/1311.2901
[5 π] Main paper that introduced AlexNet: https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
PLAYLISTS FROM MY CHANNEL
β Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd 5sGLnbgE8Poer1Xjzz4h
β Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk h1H_W3V
β Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
π Mathematics for Machine Learning: https://imp.i384100.net/MathML
π Calculus: https://imp.i384100.net/Calculus
π Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
π Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
π Linear Algebra: https://imp.i384100.net/LinearAlgebra
π Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
π β Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
π Python for Everybody: https://imp.i384100.net/python
π MLOps Course: https://imp.i384100.net/MLOps
π Natural Language Processing (NLP): https://imp.i384100.net/NLP
π Machine Learning in Production: https://imp.i384100.net/MLProduction
π Data Science Specialization: https://imp.i384100.net/DataScience
π Tensorflow: https://imp.i384100.net/Tensorflow
CHAPTERS
00:00 What is 1x1 convolution?
01:00 Walking through an AlexNet architecture diagram
03:10 Some problems with the architecture
07:08 Rewrite architecture using 1x1 convolutions
16:20 Coding 1x1 convolutions and comparing performance with/without it.
19:17 Quiz Time
20:11 Summary Pointwise Convolutions - EXPLAINED (with code)](https://i.ytimg.com/vi/aUAympGhWtE/mqdefault.jpg)