Uploaded September 2022 | Updated September 2026, 8 minutes ago
Stable Diffusion is a text-based image generation machine learning model released by Stability.AI. It's default ability generated image from text, but the model is open source which means that it can also do much more. In this video I explain how Stable Diffusion works at a high level, briefly talk about how it is different from other Diffusion-based models, compare it to DALL-E 2, and mess around with the code.
Outline
0:00 - Intro
1:58 - Stable Diffusion Explained
4:32 - Why The Buzz?
6:46 - Starting The Code
12:45 - DALL-E 2 Comparison
20:15 - Custom Pipeline
32:01 - Making Diffusion Videos
37:30 - Generating Similar Images
40:23 - Image-to-Image
53:42 - Wrapping it Up
Social Media
YouTube - youtube.com/c/EdanMeyer
Twitter - twitter.com/ejmejm1
Sources:
Colab Notebook - colab.research.google.com/drive/1_kbRZPTjnFgViPrmGcUsaszEdYa8XTpq?usp=sharing
Blog post - stability.ai/blog/stable-diffusion-public-release
Source Code - github.com/CompVis/stable-diffusion
Hugging Face Models - huggingface.co/spaces/stabilityai/stable-diffusion
Paper - arxiv.org/pdf/2112.10752.pdf
Stable Diffusion is a text-based image generation machine learning model released by Stability.AI. It's default ability generated image from text, but the model is open source which means that it can also do much more. In this video I explain how Stable Diffusion works at a high level, briefly talk about how it is different from other Diffusion-based models, compare it to DALL-E 2, and mess around with the code.
Outline
0:00 - Intro
1:58 - Stable Diffusion Explained
4:32 - Why The Buzz?
6:46 - Starting The Code
12:45 - DALL-E 2 Comparison
20:15 - Custom Pipeline
32:01 - Making Diffusion Videos
37:30 - Generating Similar Images
40:23 - Image-to-Image
53:42 - Wrapping it Up
Social Media
YouTube - youtube.com/c/EdanMeyer
Twitter - twitter.com/ejmejm1
Sources:
Colab Notebook - colab.research.google.com/drive/1_kbRZPTjnFgViPrmGcUsaszEdYa8XTpq?usp=sharing
Blog post - stability.ai/blog/stable-diffusion-public-release
Source Code - github.com/CompVis/stable-diffusion
Hugging Face Models - huggingface.co/spaces/stabilityai/stable-diffusion
Paper - arxiv.org/pdf/2112.10752.pdf
![ML Research Idea [Zero to Paper]](https://i.ytimg.com/vi/nSEb6w_BBqE/mqdefault.jpg "ML Research Idea [Zero to Paper]
This episode (part 2) of Zero to Paper covers the idea we will be working on: Text to Goal, or TTG for short. TTG aims to translate natural language into a reward function for a Reinforcement Learning problem. This research project aims to leverage recent advancements in NLP and Computer Vision to make reward functions easier and more natural to craft.
I also briefly touch on how I come up with ideas an what is important to me. I hope this will be helpful to anyone wonder how to do ML research!
Zero to Paper playlist: https://www.youtube.com/watch?v=74fKCvr5n5o&list=PL_49VD9KwQ_ONxENRk11jFEI3_pqAwaug
RL Theory series if you want to get into RL: https://www.youtube.com/watch?v=1OI0uuz9jkI&list=PL_49VD9KwQ_OML1Knh-Yb7FUFkhTLS0jL")
![Learning Language Through Games [Zero to Paper]](https://i.ytimg.com/vi/qY0nCUeQlXI/mqdefault.jpg "Learning Language Through Games [Zero to Paper]
Lets talk about natural language in Reinforcement Learning. Its also a form of language grounding because models are trained to learn connections between language and a non-text environments. I think language-conditioned RL is the way forward for making more efficient, general AI training. Let me know what you think of this combination between NLP and RL in the comments!
Zero to Paper playlist: https://www.youtube.com/playlist?list=PL_49VD9KwQ_ONxENRk11jFEI3_pqAwaug
Inverse Reinforcement Learning video: https://www.youtube.com/watch?v=qo355ALvLRI
Papers covered:
https://arxiv.org/pdf/2005.09382.pdf
https://arxiv.org/pdf/1902.07742.pdf
https://arxiv.org/pdf/1806.01946.pdf")
