Uploaded August 2023 | Updated September 2026, 1 week ago
π¨βπ©βπ§βπ¦ Join our Discord community π¨βπ©βπ§βπ¦
discord.gg/peBrCpheKE
Filtering the bi-text data.
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° BECOME A PATREON OF THE AI EPIPHANY β€οΈ
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#opensource #meta #nolanguageleftbehind
π¨βπ©βπ§βπ¦ Join our Discord community π¨βπ©βπ§βπ¦
discord.gg/peBrCpheKE
Filtering the bi-text data.
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° BECOME A PATREON OF THE AI EPIPHANY β€οΈ
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#opensource #meta #nolanguageleftbehind





![DALL-E mini explained | min(DALL-E) | Craiyon | ML Coding Series
β€οΈ Become The AI Epiphany Patreon β€οΈ
https://www.patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community π¨βπ©βπ§βπ¦
https://discord.gg/peBrCpheKE
In the 6th video of the ML coding series I start explaining the DALL-E mini project - the open-source implementation of DALL-E. I start with its minimal port into PyTorch called min(DALL-E).
I first give you the necessary context by walking you through the VQ-GAN, BART, GLU, and DALL-E papers as well as the Weights & Biases report on DALL-E mini, and then I dig into the actual code!
Let me know how you like this video!
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
β
min-dalle code: https://github.com/kuprel/min-dalle
My previous relevant videos:
β
VQ-GAN: https://www.youtube.com/watch?v=j2PXES-liuc
β
VQ-VAE: https://www.youtube.com/watch?v=VZFVUrYcig0
β
DALL-E: https://www.youtube.com/watch?v=jMqLTPcA9CQ
β
Weights & Biases DALL-E mini report: https://wandb.ai/dalle-mini/dalle-mini/reports/DALL-E-Mini-Explained-with-Demo Vmlldzo4NjIxODA
β
Rivers Have Wings tweet: https://twitter.com/RiversHaveWings/status/1478093658716966912
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 Intro
00:02:12 VQGAN overview
00:08:42 Conditioning in VQGAN
00:14:00 BART transformer
00:18:25 DALL-E 1 overview
00:24:13 DALL-E mini Weights & Biases report
00:30:35 [code] min-dalle
00:34:23 Text tokenizer
00:41:50 BART encoder
00:44:22 GLU explained (paper + code)
00:51:22 BART decoder
00:58:35 Image latent vector autoregressive generation
01:05:10 Super conditioning, top-k sampling
01:09:53 VQGAN decoder
01:15:05 Outro
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° BECOME A PATREON OF THE AI EPIPHANY β€οΈ
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany - https://www.patreon.com/theaiepiphany
One-time donation - https://www.paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - https://www.linkedin.com/in/aleksagordic/
π¦ Twitter - https://twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - https://discord.gg/peBrCpheKE
πΊ YouTube - https://www.youtube.com/c/TheAIEpiphany/
π Medium - https://gordicaleksa.medium.com/
π» GitHub - https://github.com/gordicaleksa
π’ AI Newsletter - https://aiepiphany.substack.com/
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#dallemini #imagesynthesis #mindalle DALL-E mini explained | min(DALL-E) | Craiyon | ML Coding Series](https://i.ytimg.com/vi/x_8uHX5KngE/mqdefault.jpg)




