Evolution of Autoencoders - Explained! @CodeEmporium
Evolution of Autoencoders - Explained!  @CodeEmporium
Uploaded April 2026 | Updated November 2026, 4 hours ago
In this video, we take a look at a core component of DALL-E text-to-image generation: discrete autoencoders. What is it? Why do we have it? How does it look? We specifically looks at vanilla Autoencoders, Variational Auto-encoders and VQ-VAEs.

ABOUT ME
β­• Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
πŸ“š Medium Blog: medium.com/@dataemporium
πŸ’» Github: github.com/ajhalthor
πŸ‘” LinkedIn: linkedin.com/in/ajay-halthor-477974bb

RESOURCES
[1 πŸ“š] Slides: link.excalidraw.com/p/readonly/GElfVd51jvXhYuQ6yjns
[2 πŸ“š] Paper that suggests Autoencoders address β€œback propagation without a teacher”: https://proceedings.mlr.press/v27/baldi12a/baldi12a.pdf
[3 πŸ“š] Early paper on auto encoders that compared performance vs PCA (2006): https://www.cs.toronto.edu/~hinton/absps/science.pdf
[4 πŸ“š] 2013 VAE paper: arxiv.org/abs/1312.6114?utm_source=chatgpt.com
[5 πŸ“š] 2017 VQ-VAE paper: papers.nips.cc/paper_files/paper/2017/file/7a98af17e63a0ac09ce2e96d03992fbc-Paper.pdf
[6 πŸ“š] 2017 paper on discrete variational auto encoders: arxiv.org/pdf/1609.02200
[7 πŸ“š] A digestible, yet formal introduction to discrete VAE: arxiv.org/pdf/2505.10344
[8 πŸ“š] Paper that shows how to recover from posterior collapse: openreview.net/pdf/729562a11b8fe6b0af7244d73dea98ec6c5f8376.pdf?utm_source=chatgpt.com


PLAYLISTS FROM MY CHANNEL
β­• Reinforcement Learning: youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
β­• Transformers from Scratch: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
β­• ChatGPT Playlist: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
β­• Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
β­• The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
β­• Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
β­• Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD


MATH COURSES (7 day free trial)
πŸ“• Mathematics for Machine Learning: imp.i384100.net/MathML
πŸ“• Calculus: imp.i384100.net/Calculus
πŸ“• Statistics for Data Science: imp.i384100.net/AdvancedStatistics
πŸ“• Bayesian Statistics: imp.i384100.net/BayesianStatistics
πŸ“• Linear Algebra: imp.i384100.net/LinearAlgebra
πŸ“• Probability: imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
πŸ“• ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
πŸ“• Python for Everybody: imp.i384100.net/python
πŸ“• MLOps Course: imp.i384100.net/MLOps
πŸ“• Natural Language Processing (NLP): imp.i384100.net/NLP
πŸ“• Machine Learning in Production: imp.i384100.net/MLProduction
πŸ“• Data Science Specialization: imp.i384100.net/DataScience
πŸ“• Tensorflow: imp.i384100.net/Tensorflow

CHAPTERS
00:00 What is DALL-E?
01:08 Autoencoders
02:59 What are Variational Autoencoders?
03:22 How VAE is better suited for generation than AE.
05:18 VAE structure and forward pass
07:09 Reparameterization trick
12:09 VAE loss function
13:49 VAE inference
14:44 What is VQ-VAE, forward pass, loss
18:06 Straight through estimator
20:08 Posterior Collapse
23:52 Discrete representations
25:00 Compatibility with sequence models (and DALL-E)
25:56 Quiz Time
26:52 Summary
Evolution of Autoencoders - Explained!Boltzmann Machine - Explained!COCO Dataset and its use in Computer Vision #machinelearning #deeplearningMasked RCNN summary #deeplearning #machinelearningReinforcement Learning: on-policy vs off-policy algorithmsEvolution of Neural Networks: Zero to HeroTime Series Problem for Data Scientists  #deeplearning #machinelearningR-CNN - Explained!5 concepts in transformer neural networks  part 2Vision: Structure of the eye - Explained!Informer: Time series Transformer - EXPLAINED!Pointwise Convolutions - EXPLAINED (with code)
CodeEmporium |

Evolution of Autoencoders - Explained!

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER