Mickmumpitz | How I generated a full CG Short Film with AI @mickmumpitz | Uploaded August 2022 | Updated October 2024, 1 hour ago.
I use a number of cutting-edge AI technologies and tools to create a full animated short film.
Sorry for the audio quality, this is my first project in this direction and not everything worked out as I imagined. The next ones will be better, I hope you like it anyway!
Please link me if you use this video as inspiration for your own projects!
Buy me a coffee:
ko-fi.com/mickmumpitz
INSTAGRAM: instagram.com/mickmumpitz/?hl=de
TIK TOK: tiktok.com/@mickmumpitz
Twitter: twitter.com/mickmumpitz
MickMumpitz is a channel that is all about understanding new technologies from the worlds of digital art, film and games in a playful and project-oriented way.
TOOLS USED IN THIS VIDEO:
Idea
plot-generator.org.uk
Screenwriting
GPT 3 - text-davinci-002 (beta.openai.com/playground)
Character Designs & Concept Art
craiyon (craiyon.com/) & Midjourney (midjourney.com/home/)
Character Modeling
PIFuHD (shunsukesaito.github.io/PIFuHD/)
Voice Acting
Replica Studios (replicastudios.com/)
Environments
Midjourney + 3dphoto.io (3dphoto.io/uploader/)
Facial Animation
Nvidia Omniverse - Audio2Face (nvidia.com/en-us/omniverse/apps/audio2face/)
Rigging & Animation
Adobe Mixamo (midjourney.com/home/)
I use a number of cutting-edge AI technologies and tools to create a full animated short film.
Sorry for the audio quality, this is my first project in this direction and not everything worked out as I imagined. The next ones will be better, I hope you like it anyway!
Please link me if you use this video as inspiration for your own projects!
Buy me a coffee:
ko-fi.com/mickmumpitz
INSTAGRAM: instagram.com/mickmumpitz/?hl=de
TIK TOK: tiktok.com/@mickmumpitz
Twitter: twitter.com/mickmumpitz
MickMumpitz is a channel that is all about understanding new technologies from the worlds of digital art, film and games in a playful and project-oriented way.
TOOLS USED IN THIS VIDEO:
Idea
plot-generator.org.uk
Screenwriting
GPT 3 - text-davinci-002 (beta.openai.com/playground)
Character Designs & Concept Art
craiyon (craiyon.com/) & Midjourney (midjourney.com/home/)
Character Modeling
PIFuHD (shunsukesaito.github.io/PIFuHD/)
Voice Acting
Replica Studios (replicastudios.com/)
Environments
Midjourney + 3dphoto.io (3dphoto.io/uploader/)
Facial Animation
Nvidia Omniverse - Audio2Face (nvidia.com/en-us/omniverse/apps/audio2face/)
Rigging & Animation
Adobe Mixamo (midjourney.com/home/)
![Turn yourself into ANY STYLE with ComfyUI [PS1, 3D Animation, Anime…]](https://i.ytimg.com/vi/efxYEbF793c/hqdefault.jpg "Turn yourself into ANY STYLE with ComfyUI [PS1, 3D Animation, Anime…]
Ill show you how you can turn your videos into any style you want (Disney Pixar 3D animation, anime or retro games) for free using ComfyUI!
If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz
Follow me on Twitter: https://twitter.com/mickmumpitz
👉 Download the FREE workflow here: https://www.patreon.com/posts/98818966?pr=true
INSTALLATION
1. Download ComfyUI: https://github.com/comfyanonymous/ComfyUI
2. Download ComfyUI Manager: https://civitai.com/models/71980/comfyui-manager
- if it is not showing up try this version: https://github.com/ltdrdata/ComfyUI-Manager
3. Download the MODELS: https://docs.google.com/document/d/10TQm76Ositv85PIxiz7DssFXH1V47Uvqi8yxui8R6AA/edit?usp=sharing
4. Import the & have fun creating amazing AI Animation!
Models shown in the Video:
Pixar: https://civitai.com/models/65203/disney-pixar-cartoon-type-a
Flat2d Animerge: https://civitai.com/models/35960/flat-2d-animerge
Find other Models: Civitai.com
CHAPTERS
00:00 Intro
00:46 ComfyUI Installation
02:25 First Example
03:02 Workflow Walk-through
06:42 No talking / No People
07:24 Changing the Style")
![ChatGPT can model FULL 3D SCENES now!? [Free Blender + ChatGPT Workflow]](https://i.ytimg.com/vi/esxvmwHU_ak/hqdefault.jpg "ChatGPT can model FULL 3D SCENES now!? [Free Blender + ChatGPT Workflow]
Today were putting ChatGPTs 3D modeling capabilities to the test. Is AI the future of modeling?
If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz
Follow me on Twitter: https://twitter.com/mickmumpitz
Well explore the Large Language Model (LLM) ChatGPT on modeling a donut based on blendergurus famous donut tutorial. We will also test its 3D modeling capabilities on a futuristic sci-fi city and a lakeside village.
This is made possible by chatGPTs Python capabilities, which allow us to easily generate and copy complex scenes into Blender as code.
What do you think: Will we model based on prompts in the future or will we have an AI 3D co-pilot to help us create complex shader meshes, geometry node setups or layout geometry?
TOOLS USED:
- ChatGPT https://chatgpt.com/
- blender https://www.blender.org/
- udio (for the cube song) https://www.udio.com/
CHAPTERS
00:00 Intro
00:37 Modeling a donut
04:02 Creating a sci-fi city
07:08 Final Renderings")
![Create mind-blowing AI RENDERINGS of your 3D animations! [Free Blender + SDXL]](https://i.ytimg.com/vi/mu3JEfx3PHM/hqdefault.jpg "Create mind-blowing AI RENDERINGS of your 3D animations! [Free Blender + SDXL]
Ill show you how you can render any 3D scene with AI!
If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz
And follow me on Twitter: https://twitter.com/mickmumpitz
👉 You can download the free workflows & installation guide here: https://www.patreon.com/posts/free-workflow-ai-100595649?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
👉 Download the Advanced Workflows and Bonus Files here: https://www.patreon.com/posts/advanced-guide-100596644?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
👉 Here you can find a super long bonus tutorial for this workflow: https://www.patreon.com/posts/bonus-tutorial-100590607?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
SPECS
I tested this workflow on a machine with an RTX2070 SUPER 8GB VRAM. It works but I highly recommend better GPUs for a smoother experience!
CHAPTERS
00:00 Intro
00:36 Creating a scene in blender
02:09 Creating render passes
04:24 ComfyUI setup
06:13 Generating some images
08:44 Video workflow
10:58 Rendering a CG movie scene
SUMMARY:
For over a year I’ve been saying that AI is the future of Rendering.
So today I want to share a workflow with you that will allow you to render any 3D scene with AI in any style you want! You’ll also be able to create individual prompts for all the parts of the image allowing for full control over the final rendering whether it’s an Image or a Video!
On the way I want to create some amazing renderings for instagram and tiktok and also re-render a scene from my AI Pixar movie where I combined different generative tools to create a full short film.
The secret of this AI rendering pipeline is a combination of the free 3D animation software Blender and the node-based interface for stable diffusion called ComfyUI. The special feature of this AI workflow is that we do not transform a rendering with AI (vid2vid), but only pass on the 3D data of the scene in the form of render passes, which we use in Control Net. This means that the final rendering is completely prompt-based and we can create our own prompts for all areas of the image.")
![My hack for AI MUSIC VIDEOS! [Free Workflow!]](https://i.ytimg.com/vi/mwWS8DyG_HU/hqdefault.jpg "My hack for AI MUSIC VIDEOS! [Free Workflow!]
Today Ill show you how to generate music videos with Stable Diffusion based on Windows Media Player or completely custom visuals made in After Effects.
If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz
And follow me on Twitter: https://twitter.com/mickmumpitz
Tools used in this video:
- Windows Media Player LegacyOBS Studio https://obsproject.com/Stable Diffusion WebUI https://github.com/AUTOMATIC1111/stable-diffusion-webui
- Control net https://github.com/AUTOMATIC1111/stable-diffusion-webui/discussions/7784
- Splitter AI https://vocalremover.org/splitter-ai
- Adobe After Effects
My settings file: https://drive.google.com/file/d/1u9QUDRFjcmFLS0W9myA7zL2lcF5fc4hL/view?usp=sharing
Rotation Expression: https://drive.google.com/file/d/1CYFntzHk1pZVy47AKBi6vlt2TqS8VlEd/view?usp=drive_link
LINKS:
- Spiral Animation Tutorial: https://www.youtube.com/watch?v=5Es5MRSe_V0-
- How to Install Stable Diffusion - automatic1111: https://www.youtube.com/watch?v=kqXpAKVQDNU&list=PLXS4AwfYDUi5sbsxZmDQWxOQTml9Uqyd2-
- Stable Diffusion for Beginners: https://www.youtube.com/watch?v=nJlHJZo66UA
CHAPTERS:
00:00 Intro
01:28 The Process
02:22 Finding the right song
03:42 Setting up Deforum
06:16 Prompting
08:44 Control Net
09:26 Optical Flow
10:16 Visualization After Effects
11:49 controllism
14:30 Final Results")
