Common Sense Made Simple | ControlNet img2img Stable Diffusion Automatic1111 Deforum @iamYork_ | Uploaded 1 year ago | Updated 2 minutes ago
JOIN this CHANNEL to get Access to CUSTOM Trained AI models, My Colab Notebooks, One on One AI Technical Support, Project Files, Settings, Copyright free Music and UNIQUE Text Prompts:
youtube.com/channel/UC11G7rbLqN6dtSHcpKNnIoQ/join
This was one of my first tries using Controlnet on a short img2ing PNG sequence of my wife kissing our daughter... Does anyone even read this? I do not believe you... Prove it by leaving a comment...
iamYork has also launched a limited clothing line where ALL PROFITS
go to independent artists: PLEASE INDULGE : etsy.com/shop/iamYork
iamYork Imagery is a boutique Design, Animation, and Visual Effects studio in Hell's kitchen, New York city created by Nicolas Fenrir Tengri, a mixed media artist, animator and anti-designer...
iamYork's Website iamyork.com
Royalty FREE No Copyright Music: pond5.com/artist/iamyork
Instagram: instagram.com/i.am.york
Facebook: facebook.com/ARTorFACT
Twitter: twitter.com/FenrirTengri
TikTok: tiktok.com/@i.am.york
NFT Art & Animation : Opensea: opensea.io/iamYork
ALL my tutorials and comparisons: youtube.com/playlist?list=PLVWl_nVCEeEzVmb0--9AEGHTL1pa97FGn
MORE Stable Diffusion alongside Dall-E 2 Tutorials and Examples: youtube.com/playlist?list=PLVWl_nVCEeEwy_J_lrZOrelwF22Ikrbsp
If you just want to see more "AI generated" Anime this is that playlist: youtube.com/playlist?list=PLVWl_nVCEeExAXO8a18VjbZOHEFKcisW0
After Effects & Cinema 4D Tutorials: youtube.com/playlist?list=PLVWl_nVCEeEzveVd8tyXzOlSuP0-1ecav
My "traditional" Digital Animation and Independent Experimental Film Work can be found here: youtube.com/playlist?list=PLVWl_nVCEeEzujp534UtDOzOEcbFrA2k2
What is ControlNet?
ControlNet was introduced in Adding Conditional Control to Text-to-Image Diffusion Models by Lvmin Zhang and Maneesh Agrawala. It introduces a framework that allows for supporting various spatial contexts that can serve as additional conditionings to Diffusion models such as Stable Diffusion. The diffusers implementation is adapted from the original source code.
Training ControlNet is comprised of the following steps:
Cloning the pre-trained parameters of a Diffusion model, such as Stable Diffusion's latent UNet, (referred to as “trainable copy”) while also maintaining the pre-trained parameters separately (”locked copy”). It is done so that the locked parameter copy can preserve the vast knowledge learned from a large dataset, whereas the trainable copy is employed to learn task-specific aspects.
The trainable and locked copies of the parameters are connected via “zero convolution” layers (see here for more information) which are optimized as a part of the ControlNet framework. This is a training trick to preserve the semantics already learned by frozen model as the new conditions are trained...
What is stable diffusion AI?
Stable Diffusion is a machine learning, text-to-image model to generate digital images from natural language descriptions. The underlying approach was developed at LMU Munich and then extended by a collaboration of StabilityAI, LMU, and Runway with support from EleutherAI and LAION...
If you have red this far down I appreciate you... We put a lot of time into making everything on this channel and it is people like you that help us keep going... Thanks again from the bottom of our blood-pumping chest devices...
... Nick Tengri & Rick York ...
: Common Sense Made Simple :
#controlnet #stablediffusion #AI
JOIN this CHANNEL to get Access to CUSTOM Trained AI models, My Colab Notebooks, One on One AI Technical Support, Project Files, Settings, Copyright free Music and UNIQUE Text Prompts:
youtube.com/channel/UC11G7rbLqN6dtSHcpKNnIoQ/join
This was one of my first tries using Controlnet on a short img2ing PNG sequence of my wife kissing our daughter... Does anyone even read this? I do not believe you... Prove it by leaving a comment...
iamYork has also launched a limited clothing line where ALL PROFITS
go to independent artists: PLEASE INDULGE : etsy.com/shop/iamYork
iamYork Imagery is a boutique Design, Animation, and Visual Effects studio in Hell's kitchen, New York city created by Nicolas Fenrir Tengri, a mixed media artist, animator and anti-designer...
iamYork's Website iamyork.com
Royalty FREE No Copyright Music: pond5.com/artist/iamyork
Instagram: instagram.com/i.am.york
Facebook: facebook.com/ARTorFACT
Twitter: twitter.com/FenrirTengri
TikTok: tiktok.com/@i.am.york
NFT Art & Animation : Opensea: opensea.io/iamYork
ALL my tutorials and comparisons: youtube.com/playlist?list=PLVWl_nVCEeEzVmb0--9AEGHTL1pa97FGn
MORE Stable Diffusion alongside Dall-E 2 Tutorials and Examples: youtube.com/playlist?list=PLVWl_nVCEeEwy_J_lrZOrelwF22Ikrbsp
If you just want to see more "AI generated" Anime this is that playlist: youtube.com/playlist?list=PLVWl_nVCEeExAXO8a18VjbZOHEFKcisW0
After Effects & Cinema 4D Tutorials: youtube.com/playlist?list=PLVWl_nVCEeEzveVd8tyXzOlSuP0-1ecav
My "traditional" Digital Animation and Independent Experimental Film Work can be found here: youtube.com/playlist?list=PLVWl_nVCEeEzujp534UtDOzOEcbFrA2k2
What is ControlNet?
ControlNet was introduced in Adding Conditional Control to Text-to-Image Diffusion Models by Lvmin Zhang and Maneesh Agrawala. It introduces a framework that allows for supporting various spatial contexts that can serve as additional conditionings to Diffusion models such as Stable Diffusion. The diffusers implementation is adapted from the original source code.
Training ControlNet is comprised of the following steps:
Cloning the pre-trained parameters of a Diffusion model, such as Stable Diffusion's latent UNet, (referred to as “trainable copy”) while also maintaining the pre-trained parameters separately (”locked copy”). It is done so that the locked parameter copy can preserve the vast knowledge learned from a large dataset, whereas the trainable copy is employed to learn task-specific aspects.
The trainable and locked copies of the parameters are connected via “zero convolution” layers (see here for more information) which are optimized as a part of the ControlNet framework. This is a training trick to preserve the semantics already learned by frozen model as the new conditions are trained...
What is stable diffusion AI?
Stable Diffusion is a machine learning, text-to-image model to generate digital images from natural language descriptions. The underlying approach was developed at LMU Munich and then extended by a collaboration of StabilityAI, LMU, and Runway with support from EleutherAI and LAION...
If you have red this far down I appreciate you... We put a lot of time into making everything on this channel and it is people like you that help us keep going... Thanks again from the bottom of our blood-pumping chest devices...
... Nick Tengri & Rick York ...
: Common Sense Made Simple :
#controlnet #stablediffusion #AI
