MickmumpitzI'll show you how to use ComfyUI to create consistent characters, pose them, automatically integrate them into AI-generated backgrounds and even control their emotions with simple prompts. If you like my work, please consider supporting me on Patreon: patreon.com/Mickmumpitz Follow me on Twitter: twitter.com/mickmumpitz
I developed this ComfyUI workflow in preparation for one of the next AI 3D rendering workflows, in which we will look at animating characters. But you can also use this workflow for many other exciting things: to create children's books, AI movies or one of these AI influencers everyone keeps talking about!
Create Consistent, Editable AI Characters & Backgrounds for your Projects! (ComfyUI Tutorial)Mickmumpitz2024-04-29 | I'll show you how to use ComfyUI to create consistent characters, pose them, automatically integrate them into AI-generated backgrounds and even control their emotions with simple prompts. If you like my work, please consider supporting me on Patreon: patreon.com/Mickmumpitz Follow me on Twitter: twitter.com/mickmumpitz
I developed this ComfyUI workflow in preparation for one of the next AI 3D rendering workflows, in which we will look at animating characters. But you can also use this workflow for many other exciting things: to create children's books, AI movies or one of these AI influencers everyone keeps talking about!
Chapters: 00:00 Intro 01:09 Character Sheet 04:49 Loras & Midjourney 05:48 Controllable Characters 10:42 OutroCreate CONSISTENT CHARACTERS for your projects with FLUX! (ComfyUI Tutorial)Mickmumpitz2024-10-10 | Unlock the secret to perfect characters in AI art with this in-depth tutorial!
Lora training is easy now! Learn how to use FLUX, ComfyUI, and SDXL to create AI characters for movies, children's books, and virtual influencers. Discover techniques for generating AI character sheets, training custom Loras, and achieving consistent results across multiple images. This guide covers advanced workflows, Flux Gym, Pinokio, and FLUX Lora training. Perfect for creators looking to elevate their AI art and storytelling capabilities.
Chapters: 00:00 Intro 00:50 Process 01:35 Flux Workflow 04:21 Advanced Versions 04:45 Limitations 05:34 SDXL Version 06:40 Preparing the Images 07:38 Flux Gym 09:31 Using the LoRA 11:46 Multiple CharactersGenerate STUNNING SET EXTENSIONS For Your Projects! [2D & 3D | FREE Blender + AI]Mickmumpitz2024-09-16 | I show you how to create amazing 2D & 3D set extensions with my new FREE AI workflows for ComfyUI & blender.
Here are two powerful AI VFX workflows for creating stunning set extensions for your video projects. The first workflow enables selective image inpainting, similar to Photoshop's generative fill but more advanced and free. The second workflow seamlessly integrates 3D models into scenes, matching lighting, colors, and style.
Learn how to use and install these free tools step-by-step to elevate your visual effects and expand creative possibilities in filmmaking and video production using the power of AI. Matte paintings and set extensions have never been so easy!
Chapters: 00:00 Intro 00:55 Preparation 01:35 ComfyUI Installation 03:37 Using the 2D Workflow 05:10 2D Workflow Walkthrough 07:11 Compositing 2D 07:35 3D Workflow Preparation 12:12 Using the 3D Workflow 15:03 Compositing 3D + Tips & TricksGenerate ENTIRE 3D SETS For Your Projects FAST! [FREE Blender + SDXL/FLUX Workflow]Mickmumpitz2024-08-28 | I’ll show you how you can create a simple 360 degree layout scene in blender and turn it into entire 3D environments!
*Affiliate Links: Help support the channel at no extra cost for you if you decide to sign up!
You can use this workflow in your browser or install it locally for free and use it with your favorite Stable Diffusion model or even with the brand new, absolutely mind blowing FLUX image model by Black Forest Labs.
I’ll also show you how you can seamlessly integrate characters or other assets into these 3D environments, how to combine them with my AI compositing workflow for a full low budget virtual production environment and I also want to try traveling to these worlds using my VR headset to see if they hold up in person.
So whether you need background stages for games, digital sets for cg movies or live action vfx shots, this workflow will let you speedrun environment creation for your projects.
CHAPTERS:
00:00 Intro 00:55 Creating a scene 01:35 Render Passes 05:17 LeonardoAI 09:12 ComfyUI: SDXL 10:10 ComfyUI: FLUX 11:45 VR 12:40 Adding Characters & Assets 15:35 Virtual Production 16:14 Animated EnvironmentsThis free MIND BLOWING Workflow Just Changed FilmmakingMickmumpitz2024-08-09 | AI is the future of VFX! In this deep dive, I'll show you a free workflow for compositing any video on any background for your movie projects.
Easily composite any video on any background with one click! I developed a free AI-powered ComfyUI workflow to automatically cut out the subject, match the lighting, fix edges, and add additional VFX. Just import video and background, wait a few minutes, and get your final shot. Fine-tune and control the result further with traditional VFX tools like Blender and After Effects, and other mind-blowing AI tools. Whether you're creating a music video or sci-fi short, this workflow can transform the way you make movies!
Tools used:
ComfyUI BlenderAfter Effects
Chapters:
00:00 Intro 00:51 AI Greenscreen 02:45 Relighting 04:00 Workflow (Simple) 08:36 Workflow (Advanced) 10:25 EXAMPLES 16:43 InstallationNext level AI Filmmaking: Turn your storyboard sketches into MOVIES!Mickmumpitz2024-07-19 | Control AI with sketches: Here is how you can turn your storyboards into full AI movies for free!
This Stable Diffusion workflow can be combined with my character model sheet workflow for consistency. It's great for movie pre-visualization, concept art, or graphic novel panels, since it can handle multiple characters through automatic regional prompting. To demonstrate its full potential, I'll use it with Dream Machine, Claude 3.5 Sonnet, ElevenLabs, Udio, and DaVinci Resolve to create a full AI short film about the endless fight between knights and gnomes.
Chapters 00:00 Intro 01:00 Demonstration 03:00 Installation 06:00 Simple Workflow 09:23 Advanced Workflow 10:33 Tips & Tricks 11:12 Short Film Process 13:44 Final Short Film 15:45 OutroMake your own ANIME with this new mind-blowing AI TOOL! (ComfyUI Tutorial + FREE Workflows!)Mickmumpitz2024-06-19 | AI movies are finally controllable! I show you how to combine my consistent & poseable character workflow with a new tool called tooncrafter to create completely consistent AI animation.
Chapters: 00:00 Intro & Overview 01:00 The Tool 02:00 midjourney 02:37 Tooncrafter on Huggingface 03:04 Using Photoshop 03:37 Create a model sheet in ComfyUI 04:19 Posing the Character 06:34 Animating the character 08:02 CleanUp & Upscale 09:05 Reference to AnimeChatGPT can model FULL 3D SCENES now!? [Free Blender + ChatGPT Workflow]Mickmumpitz2024-06-03 | Today we're putting ChatGPT's 3D modeling capabilities to the test. Is AI the future of modeling? If you like my work, please consider supporting me on Patreon: patreon.com/Mickmumpitz Follow me on Twitter: twitter.com/mickmumpitz
We'll explore the Large Language Model (LLM) ChatGPT on modeling a donut based on blendergurus famous donut tutorial. We will also test its 3D modeling capabilities on a futuristic sci-fi city and a lakeside village.
This is made possible by chatGPT's Python capabilities, which allow us to easily generate and copy complex scenes into Blender as code.
What do you think: Will we model based on prompts in the future or will we have an AI 3D co-pilot to help us create complex shader meshes, geometry node setups or layout geometry?
CHAPTERS 00:00 Intro 00:37 Modeling a donut 04:02 Creating a sci-fi city 07:08 Final RenderingsRender STUNNING 3D animations with this AMAZING AI tool! [Free Blender + Stable Diffusion]Mickmumpitz2024-05-23 | AI rendering is the future! Here's the new version of my AI rendering workflow that lets you render any 3D scene with Stable Diffusion much faster and more consistent!
I show you how to prepare your scene in the free 3D animation software blender (but you can also use Unreal Engine, Maya, Cinema 4D, Houdini, or most other 3D software to create your scenes…) and render it with Stable Diffusion in ComfyUI.
While last time we only used SDXL and Hotshot to render our scenes, I have now added Stable Diffusion 1.5 LCM support, which significantly reduces render time and VRAM consumption.
00:00 Intro 00:31 Preparation & Recap 02:07 Depth Pass 03:15 Line Pass 03:59 Normal Pass 04:30 Mask Pass 05:20 ComfyUI 05:43 SDXL Image Workflow 08:12 NEW SD15 LCM Video Workflow 09:37 Models & Loras 10:16 Controlnet Tips & Tricks 11:36 Motion Loras 11:56 Lighting Pass 12:25 Re-Render Scenes with AI 13:18 ipAdapterCreate mind-blowing AI RENDERINGS of your 3D animations! [Free Blender + SDXL]Mickmumpitz2024-03-18 | I'll show you how you can render any 3D scene with AI!
SPECS I tested this workflow on a machine with an RTX2070 SUPER 8GB VRAM. It works but I highly recommend better GPUs for a smoother experience!
CHAPTERS
00:00 Intro 00:36 Creating a scene in blender 02:09 Creating render passes 04:24 ComfyUI setup 06:13 Generating some images 08:44 Video workflow 10:58 Rendering a CG movie scene
SUMMARY:
For over a year I’ve been saying that AI is the future of Rendering.
So today I want to share a workflow with you that will allow you to render any 3D scene with AI in any style you want! You’ll also be able to create individual prompts for all the parts of the image allowing for full control over the final rendering whether it’s an Image or a Video!
On the way I want to create some amazing renderings for instagram and tiktok and also re-render a scene from my AI Pixar movie where I combined different generative tools to create a full short film.
The secret of this AI rendering pipeline is a combination of the free 3D animation software Blender and the node-based interface for stable diffusion called ComfyUI. The special feature of this AI workflow is that we do not transform a rendering with AI (vid2vid), but only pass on the 3D data of the scene in the form of render passes, which we use in Control Net. This means that the final rendering is completely prompt-based and we can create our own prompts for all areas of the image.Which AI video tool is best? ULTIMATE COMPARISON!Mickmumpitz2024-02-25 | I compare OpenAI's Sora with Pika, Runway Gen-2, Animate Diff, Stable Video Diffusion and LeonardoAI to find out if accessible video AI still has a future.
CHAPTERS: 00:00 Intro 00:53 runway GEN-2 02:37 Stable Video Diffusion 03:37 Can you direct sora? 04:07 Animate Diff 05:31 Pika 05:54 LeonardoAI 07:21 COMPARISON 10:32 Conclusion
This video is also a good overview of some of the most popular AI video tools. So if you're unsure which one to use, I hope this can help!How did I get here!? Check out my new tutorial to find out! #gaming #aiMickmumpitz2024-02-20 | ...Turn yourself into ANY STYLE with ComfyUI [PS1, 3D Animation, Anime…]Mickmumpitz2024-02-20 | I'll show you how you can turn your videos into any style you want (Disney Pixar 3D animation, anime or retro games) for free using ComfyUI!
CHAPTERS 00:00 Intro 00:46 ComfyUI Installation 02:25 First Example 03:02 Workflow Walk-through 06:42 No talking / No People 07:24 Changing the StyleLip Sync for your AI MOVIES!Mickmumpitz2024-02-11 | Here are two AI Tools for creating lip sync for your AI movies!
Chapters 00:00 Intro 00:16 Synclabs 00:51 The old method 02:00 Wav2Lip 02:56 ComfyUI Clean upTurn yourself into a ZOMBIE with this free AI tool! (ComfyUI Tutorial)Mickmumpitz2024-01-18 | I created an AI workflow for generating AI VFX that automatically works for every type of shot that you throw at it.
00:00 Intro 00:38 The Tool & Setup 01:43 The Workflow 04:40 Customization 05:03 ResultsI generated a 3D Pixar movie with AI and now Im scaredMickmumpitz2023-11-29 | Right now, the first 500 people to use my link will get a one month free trial of Skillshare: https://skl.sh/mickmumpitz11231
I show you how you can combine 5 AI tools to create 3D animated AI movies!
CHAPTERS: 00:00 Intro 00:20 Script 01:29 Generate 3D Models 02:55 Join Skillshare today! 04:11 AI Animation 06:33 AI Facial Animation 08:09 Finalization 09:19 Conclusion 10:08 Final Movie!Would you dive there? 🤔 | Full video on my channel! #ai #aifilmmaking #planetearthMickmumpitz2023-11-08 | ...AI-Generated BBC Planet Earth is CURSEDMickmumpitz2023-11-07 | Can AI create a nature documentary in the style of "Planet Earth"? ... Well... See for yourself.
Mickmumpitz is a channel that is all about understanding new technologies from the worlds of AI, digital art, film and games in a playful and project-oriented way.Create AI MOVIES with this FREE tool! Full Tutorial + Project FilesMickmumpitz2023-11-05 | I’m showing you how I used a NEW AI TOOL to create a terrifyingly good nature documentary!
There are a lot of new AI video generators like Runways Gen-2, Pika Labs or moonvalley. But the most impressive one for me is AnimateDiff. It’s a framework for animating txt to image models and you can install it locally on your computer. So no weird Discord interfaces, or costly subscriptions are necessary!
CHAPTERS 00:00 Intro 00:30 Concept 01:20 The Tool 02:47 ComfyUI Settings 06:04 Script 07:06 Voice + Effects 07:55 FINAL FILM! Mickmumpitz is a channel that is all about understanding new technologies from the worlds of AI, digital art, film and games in a playful and project-oriented way.Use AI to create amazing 3D Animations! [Blender + Stable Diffusion]Mickmumpitz2023-10-15 | I’ll show you how to speedrun from a rough 3D Layout scene in blender to a final textured rendering in no time with the help of AI!
The combination of Blender, a classic 3D animation tool, with AI tools like Stable Diffusion is one of my absolute favorite AI workflows because you can use it to create consistent environments for short films, games, or just start learning Blender. And it's just so much fun and super easy!
CHAPTERS 00:00 Intro 00:25 Layout 03:21 Exporting the Depth Map 05:07 Generating the image 07:22 Putting everything together 09:11 Animate the Camera + Effects 10:56 Final Results
Mickmumpitz is a channel that is all about understanding new technologies from the worlds of AI, digital art, film and games in a playful and project-oriented way.My hack for AI MUSIC VIDEOS! [Free Workflow!]Mickmumpitz2023-10-01 | Today I'll show you how to generate music videos with Stable Diffusion based on Windows Media Player or completely custom visuals made in After Effects.
00:00 Intro 01:28 The Process 02:22 Finding the right song 03:42 Setting up Deforum 06:16 Prompting 08:44 Control Net 09:26 Optical Flow 10:16 Visualization After Effects 11:49 controllism 14:30 Final ResultsGenerate ENTIRE MOVIES with AI! Full Tutorial + FREE optionsMickmumpitz2023-08-03 | This tutorial teaches you how to use various AI tools to create cinematic masterpieces.
Other resources: - ROOP Deep Fake for A1111 - Face Swap Guide youtu.be/8SWon8erHZw - DreamBooth for Automatic 1111 - Super Easy AI MODEL TRAINING! youtu.be/9Nu5tUl2zQw
Chapters: 00:00 Intro 00:42 Create Consistent Characters 02:11 Environments 02:58 Directing the Characters 04:00 Patreon 04:15 Generating movement 05:17 Facial Animation 06:37 Clean Up 07:58 Tips & Tricks 09:52 ResultTurn your AI images into CG movies [Workflow Video]Mickmumpitz2023-07-23 | This workflow explores how to use various AI tools to create compelling character animations and "render" them using AI.
Chapters: 00:00 Intro 00:32 Creating the characters 02:16 Generating the 3D model 04:03 Voice 04:26 Facial Animation 05:58 Body Animation 07:51 Patreon 08:25 "Re-Rendering" with GEN-1 11:44 "Re-Rendering" with DEFORUM 14:12 ResultsBring your AI images to life with 2D animations powered by generative fillMickmumpitz2023-06-25 | I'll show you how to use Adobe Photoshop's new Generative Fill tool to create beautiful animations in After Effects.
My goal was to create a beautiful animated fairy tale. The script was written by ChatGPT, the images were generated using Midjourney, and the animation was created using Adobe Photoshop and After Effects.
Subscribe and follow us for more AI movie techniques!
Chapters: 00:00 Intro 00:44 Generating a fairy tale 01:57 Preparing the images in PS 07:57 Animation in After Effects 11:26 Additional Effects 17:30 Final Short Film 19:35 Outro
We cover the entire workflow, from generating the 3D environment, to filming in a low-budget virtual production environment, to compositing your shot with some AI tips and tricks, like re-lighting your shot based on the environment you've created!
Chapters: 00:00 Intro 00:34 What is Virtual Production? 01:42 Generating a 360° image 03:17 Preparing the 3D Model [Depth Maps] 06:22 Filming the scene 08:05 Key out the actors 09:10 Generate Normal Maps 11:15 Putting it all together 14:11 Final Shots
Follow me on Twitter: twitter.com/mickmumpitzCreate 3D animations of your AI-generated charactersMickmumpitz2023-02-25 | In this AI filmmaking tutorial, I show you how to create cinematic 3D animations, including facial animations.
Chapters: 00:00 Intro 00:33 Standard Method 01:13 Image Generation 02:42 Facial Animation 04:06 Preparing the 3D Sequence 05:56 Setting up the Shot (Blender Tutorial) 10:09 Final Shots 10:27 Outro
Follow me on Twitter: twitter.com/mickmumpitzAI-generated 3D short film: The City on Mars!Mickmumpitz2023-02-12 | "Are you ready for an out-of-this-world adventure? Look no further than the city on Mars!"
Follow me on Twitter: twitter.com/mickmumpitzGenerate 3D SHORT FILMS from 2D AI images!Mickmumpitz2023-02-02 | We travel to the stars using the power of artificial intelligence.
While last time I used AI to create a complete short film, including characters and animation, this time I want to focus especially on creating three-dimensional backgrounds and immersive settings using an impressive free tool called “High resolution Depth Maps for Stable Diffusion”.
Chapters:
00:00 - Intro 00:25 - Story 01:18 - Image Generation 02:27 - Generating the 3D Model (old technique) 03:15 - High resolution Depth Maps 04:47 - Setting up the scene 06:30 - Examples 08:09 - Voice Over 09:20 - FINAL FILM 10:15 - Outro
Follow me on Twitter: twitter.com/mickmumpitzAI generated short film I made in August. So much has happened since then 🤯Mickmumpitz2023-02-02 | ...I re-rendered my AI-generated CG short film in Stable DiffusionMickmumpitz2023-01-16 | I am using a plugin for Blender to re-render my AI generated short movie in stable diffusion. Is this the future of 3d rendering?
Sorry for the audio quality, this is my first project in this direction and not everything worked out as I imagined. The next ones will be better, I hope you like it anyway!
Please link me if you use this video as inspiration for your own projects!
MickMumpitz is a channel that is all about understanding new technologies from the worlds of digital art, film and games in a playful and project-oriented way.
Rigging & Animation Adobe Mixamo (midjourney.com/home)I asked an AI to animate a short film and it got weirdMickmumpitz2022-08-03 | I relied on AI tools to create this short film: Script, character designs, all 3D models, facial animations, and rigging, among other things, were all created by A.I. Tools. I then curated these elements and put them together in Blender. My role was practically that of director of a film crew of intelligent robots! ;)
The collaboration was incredibly fun and I'm already looking forward to continue working with A.I. on more short films and other projects.
Soon I will release a process video explaining how exactly I used the tools to create this film. So don't forget to subscribe!
MickMumpitz is a channel that is all about understanding new technologies from the worlds of digital art, film and games in a playful and project-oriented way.