[Tutorial] Movement Controlled Instruments – TouchDesigner, Ableton Live and Kinect uisato 2022-04-01 | In the following video, you’re going to learn how to control both analog and digital instruments through movement with the help of TouchDesigner, Ableton Live and a Kinect camera.For project files, tutorials and more, head over to: https://uisato.studio/tools__00:00 – Introduction00:35 – TDAbleton01:00 – Kinect CHOP02:01 – Setting movement ranges04:51 – Sending captured data to Ableton Live07:10 – Setting our first instrument10:00 – Testing10:42 – Setting our second instrument13:06 – Final test13:50 – Tips, ideas and comments#touchdesigner #abletonlive #kinect
[Release] Realtime Audioreactive Pointclouds [v1.7] for TouchDesigner uisato 2026-09-15 | The system takes a Kinect-derived human pointcloud and lets incoming sound interact in various ways with the particles in real time, turning the performer into a responsive cloud of matter, noise, and motion.v1.7 includes 12 presets, and introduces the following features:- a procedural camera that automatically cuts to new angles around the performer, following the performer's body or a raised hand- a new look, "Afterimage": delayed versions of the performer stacked in depth, holding the last few seconds of movement- a rebuilt network that runs leaner, reads clearer, and is ready to work with [new interface, parameters, optimizations]These are raw excerpts of me playing through the system, with the visual structure reacting live to the audio signal coming from my #ableton session in real-time.Project files accessible through my Patreon profile: patreon.com/c/uisato or through the store: https://uisato.studio/tools#touchdesigner #ableton #kinect #vfx #realtime
Testing a new workflow for rapid environmental VFX - #vfx #ai #film #drone uisato 2026-09-07 | Original drone footage [bottom] alongside four alternative environmental takes; fire, rain, snow, and floral. Workflow accessible through Uisato Studio. What do you guys think?More experiments, project files, and tutorials, through YouTube, Instagram, and Patreon: patreon.com/c/uisato
Passing - An update for Perceptual Display Engine - #touchdesigner #creativecoding #nostalgia uisato 2026-08-29 | One last example output from this experimental multi-source video player designed for frame-accurate video switching, playback manipulation, and display/render interventions, now with a few optimizations made for even better performance.Visuals made on Uisato Studio.You can freely access the system through my Patreon, and/or the Tools Store.
[Release] Kinetic Synth Instrument [TouchDesigner + Ableton Live Project Files] uisato 2026-08-22 | A real-time polyrhythm instrument: multiple pendulum voices swing in TD, each on its own period and phase. When a bob crosses a shared center line → hit → MIDI note to Ableton Live (any VST). Visuals (GLSL / 3D) run off the same engine bus; not a separate animation.Up to 16 editable voices · voice table · optional ~30 min phasing composition mode.TD = physics + MIDI + look. Live = sound.Project files on Patreon / Tools Store:- patreon.com/cw/uisato- https://uisato.studio/tools#touchdesigner #ableton #abletonlive #creativecoding #vst
A new, AI motion capture workflow - #vfx #motiondesign #cinematic #film uisato 2026-08-11 | Hey guys. I've been trying to improve my AI motion capture workflows, and with the arrival of the newest models, I got really impressed with a few results.In this example you can observe a one-shot, 30 seconds motion capture, on-a-budget experiment. [Seedance 2.5]I've made the workflow accessible through Uisato Studio, if you'd like to test it out. [Seedance 2.5 video, "character swap" prompt-recipe activated.]https://uisato.studio
Perceptual Display Engine - Open Source Experimental System for #touchdesigner uisato 2026-08-04 | All output examples from my experimental multi-source video player for TouchDesigner, designed for frame-accurate video switching, playback manipulation, and display/render interventions. [And now, by popular demand, allowing even more video sources!]All videos were generated using Uisato Studio: https://uisato.studioWant access to the updated system + a detailed breakdown of exactly how I achieved the continuous motion effect on this piece? You can freely access the system from Uisato Studio's Store, and the detailed, free breakdown from my Patreon: patreon.com/uisatoPlus, many more experiments through my Instagram profile: instagram.com/uisato_#vfx #film #generativeai #ai
HUMANNEQUINS - [Uisato Studio Music Video Pro Showcase] uisato 2026-07-30 | A couple of brief example of what Uisato Studio's "Music Video Pro" mode is capable of: turning a track and a concept, into a whole audiovisual world + audioreactive performance.I've uploaded a detailed breakdown on how to accomplish this. You can freely access it through: patreon.com/cw/uisatoMore experiments, tutorials, and project files, through Instagram: instagram.com/uisato_
Music Video Pro mode is now live on Uisato Studio! uisato 2026-07-15 | A new, significantly expanded version of the original Music Video mode, now built around Seedance 2.0, multiple image references, and an even more precise creative-assistance layer designed to enhance and adapt your vision in an optimally model-aware manner.This is an example output from the system.For musicians, filmmakers, visual artists, labels, directors, and anyone trying to turn a track into a more intentional audiovisual world.Access it through: https://uisato.studio/#filmmaking #ai #aivideo #musicvideo #agenticai
Open-Sourcing Perceptual Display Engine for #touchdesigner - #vfx #shorts #dance uisato 2026-06-25 | A few more output example from this experimental multi-source video player for touchdesigner designed for frame-accurate video switching, playback manipulation, and display/render interventions.You can load multiple videos, decide exactly how many frames each source appears for, control how each source’s playhead behaves, insert black frames, switch between display modes, and save presets for different playback structures.You can freely access it from Patreon, or the Store. Plus many more experiments, through Instagram, or YouTube.Hope you all enjoy it! ♥
Audioreactivity Experiments - #touchdesigner #vfx #aivideo uisato 2026-06-16 | A couple of experiments testing light audioreactivity using a mixture of TouchDesigner, AI models, and post-processing. What do you think?More experiments, tutorials, and project files, through: https://uisato.studio/
Talk Show Host [ft. Jibaros @ssilkin ] - AI Motion Capture Experiment Nº4 + Breakdown uisato 2026-06-12 | motion_ctrl / experiment nº4choreography and performance by: instagram.com/sarasilkinvfx: instagram.com/uisato_In collaboration with Sara, I transformed an iPhone recording of this beautiful performance, into this multi-angle audiovisual piece.Want to know exactly how I accomplish this without ultra-expensive gear or a full production budget on a single platform? Breakdown freely available through my Patreon page: patreon.com/c/uisato#vfx #dance #aivideo #film
Perceptual Display Engine - TouchDesigner / Open Source - #film #vfx #edit uisato 2026-06-06 | It’s an experimental multi-source video player designed for frame-accurate video switching, playback manipulation, and display/render interventions.You can load multiple videos, decide exactly how many frames each source appears for, control how each source’s playhead behaves, insert black frames, switch between display modes, and save presets for different playback structures.Freely access it from: patreon.com/c/uisato or https://uisato.studio/tools
[Release] A.S.S - Artistic Surveillance System for TouchDesigner uisato 2026-05-31 | The starting point is simple: take live public camera feeds and treat them as raw material for a critical audiovisual instrument.Inside the patch, the incoming image is analyzed locally in real time through motion, zones, density, heat, masking, redaction, and other visual behaviors. On top of that, I built an orchestration layer with a Gemini API component and a VEO 3.1 API component for TouchDesigner, so the system can not only interpret what it is seeing through different analysis modes, but also trigger generative image-to-video interventions directly from the live feed.What interests me most is that this orchestration layer is not locked to this specific use case. Once you have a system that can observe input, interpret it through a certain logic, and route that interpretation into different outputs, its purpose can be redefined pretty radically. Today it becomes a critical surveillance instrument. Tomorrow it could become something else entirely.It is still rough and very much in development, but the core is there already, and I wanted to share this early version with you because Patreon is exactly what allows me to spend time building strange things like this before they become "finished."You can access it through:- patreon.com/c/uisato- https://uisato.studio/tools#touchdesigner #python #surveillance
A study on synthetic choreographies and AI audio-reactivity uisato 2026-05-26 | A few experiments made with Uisato Studio’s Seedance 2 "intelligent" implementation, exploring how far generative video + fine-tuned orchestration layers can be pushed in rhythm, camera language, body transformation, and audiovisual sync.https://uisato.studio/Treating AI as a new choreographic tool beyond the limits of expensive gear and traditional, full-scale production setups.Full breakdown on how I made these, through: patreon.com/c/uisato#vfx #animation #ai #choreography #dance
Talk Show Host [ft. @ssilkin ] | AI Motion Capture Experiment on Uisato Studio uisato 2026-05-22 | Choreography: @ssilkin Dancers: instagram.com/coco.joelle & instagram.com/joeythedancerMade entirely on Uisato Studio's "intelligent" Seedance 2 implementation: https://uisato.studio/#animation #vfx #vfxshorts #motiongraphics #ai
Augmented - #vfx #choreography #film #cinematography #aivideo uisato 2026-05-15 | Made entirely on Uisato Studio.
Uisato Studio is now live, worldwide uisato 2026-05-08 | The new ecosystem for AI orchestrated filmmaking.A full year of the heaviest experimentation I’ve ever put myself through, now avaialble.Link: https://uisato.studio/#vfx #seedance2 #radiohead #aivideo #choreography
[Release] PaperStrip_FX COMP | An experimental scanlike strip compositor for #touchdesigner uisato 2026-05-06 | PaperStrip_FX is a TouchDesigner COMP that turns frame history into strip-based slices: it feels like a scan/photocopy pass where time gets cut into paper bands, then reassembled with motion-reactive stepping, drift, and print artifacts. Inspired in Oi Va Voi’s Everytime music video: youtube.com/watch?v=KQhbuBBqvRY What it does• Temporal slicing: strips sample from a cache of previous frames (time becomes texture) • Motion-reactive behavior: strips can advance on motion / thresholds, or step in a stop-motion feel • Analog finishing: paper grain + micro contact shadow + emboss highlight rim • GLSL finalizer: bloom/ink spread, vignette, wobble, grain The video, on the other hand, it’s done through Uisato Studio’s Music Video mode, our flagship AI orchestration workflow, coming out this Friday Project file available through the Tools Store: https://uisato.studio/tools#vfx #mixedmedia #edit #plugin
Real-time EEG analysis-driven guided-meditation system - #touchdesigner #neuroscience uisato 2026-04-24 | An AI orchestration system inside TouchDesigner that uses Gemini to interpret rolling live brain-signal summaries [OpenBCI → TD → Python] for pertinently producing guiding cues for the meditative user; video, voice, light, and text. It all happens automatically; deciding if, when, and how to interact with the user, given a particular set of available tools [in this case, the recently released Gemini_API, ElevenLabs_SFX, and the VEO_API components.#python #programming #experiment
[Release] LongExposureFX Component for TouchDesigner | #touchdesigner #vfx #nostalgia #motion uisato 2026-04-10 | An experimental temporal ghosting / long-exposure toolkit for TouchDesigner, built for turning prerecorded and real-time footage into smeared, split-exposure, echo-like motion.The system layers delayed frames, masks the active subject region, and adds optional feedback persistence to generate distorted portrait, face, and full-body trails that sit somewhere between long exposure, temporal rupture, and spectral motion blur.This release also includes:— a custom FLUX-2 LoRA trained on experimental photography [the one used in this demonstration]— the pertinent ComfyUI workflow for FLUX-2.dev + LoRA text-to-image generationAvailable now through: https://uisato.studio/tools
[Release] Gemini API Component for TouchDesigner | #touchdesigner #gemini #coding #patreon #api uisato 2026-04-08 | A new TouchDesigner COMP for asynchronous multimodal prompting with Google Gemini 3.1.Access it through: https://uisato.studio/toolsThis component lets you send text prompts plus an optional input image directly from TouchDesigner, receive text responses back into the patch, and preserve both a local conversation history and a stateful remote interaction chain for continuity across turns. [The use of the newly implemented "Interactions API", which allows us to continue conversation through the Gemini API.]Included features:— text + image → text workflow— async requests to avoid freezing TD— support for gemini-3.1-pro-preview and gemini-3.1-flash-lite-preview— rolling local transcript + stateful conversation memory— simple patch-friendly outputs for further automation / integrationI’m also including a setup guide so you can get the component running properly inside your TouchDesigner environment.PS: In addition, you'll find a brief text file containing a way for you to use the Gemini API for free.Hope you find it useful.
More Realtime Audioreactive Pointclouds - [TouchDesigner + Ableton Live] uisato 2026-04-04 | A few more excerpts of real-time audio-reactive pointcloud usage.Project files accessible through: https://uisato.studio/tools#touchdesigner #ableton #cinematography #liveperformance #aftereffects
[Release] SHARP for TouchDesigner: Gaussian Splat from a Single Image [TOX / Project Files + Guide] uisato 2026-02-24 | I’m releasing my SHARP for TouchDesigner setup: a .tox + step-by-step install guide to generate gaussian splat [point-based 3D reconstruction] .ply files from a single image inside TouchDesigner.Includes:- TD trigger pipeline (from TOP input)- non-blocking execution + status/log feedback- auto-load into Point File In TOP- archive of generated .ply files- setup notes for CUDA-enabled PyTorch (important for speed)- GLSL pipeline for particle/point audio-reactivityYou can access it through: https://uisato.studio/toolsHope you enjoy it ♥PS: Background music by myself.#touchdesigner #3d #python #gaussiansplatting #3dmodeling
Realtime Audioreactive Pointcloud Improv | #touchdesigner #ableton #interactive #foryou #nostalgia uisato 2026-02-18 | More experiments, project files, and tutorials, through: https://uisato.studio/tools
Oírnos - [No-Hardware Motion Capture Comparison 2023 / 2026] uisato 2026-02-13 | Oírnos - [2023 / 2026 Comparison]Always getting back to this gorgeous performance from Fred Astaire and Rita Hayworth. This time, a comparison: - [bottom] intervened with various contemporary workflows to test their current state on consistency, adherence, and pose match. - [up] similar experiment, but ran exactly three years ago; February of 2023. If I recall correctly, I was using an experimental version of Stable WarpFusion on a rented GPU running on Collab.Remixed track from my debut album "ReconoɔǝЯ".#animation #choreography #nostalgia #dance
Found [You] Footage | #experimental #avantgarde #midjourney #edit #aftereffects uisato 2026-02-06 | Both music, and visuals, by myself.Project files accessible through: https://uisato.studio/tools
Oscilloscopes, everywhere - [TouchDesigner Project Files] uisato 2026-01-30 | All experimental oscilloscopes [19] I made through the past four years, in a single file.You can access these, plus many more systems, through: https://uisato.studio/tools#touchdesigner #ableton #oscilloscope #generativeart #design
Oscilloscopes, everywhere - #touchdesigner #geometry #oscilloscope #programming #vj #ableton uisato 2026-01-25 | More experiments, through: https://uisato.studio/tools
The EEG experiment continues | #touchdesigner #eeg #creativecoding #experiment #3d uisato 2026-01-20 | The expansion of the EEG patch for TouchDesigner continues.Newly added XY graph for real-time valence calculation: the emotional value of subject's brain state, ranging from negative/unpleasant [red dot] to positive/pleasant [green dot].
Motion Control Experiments | Kling + Scail + Uisato Studio - [ft @ssilkin ] uisato 2026-01-16 | Motion_ctrl / experiment nº1 and nº2ft. the amazingly talented Sara Silkin / instagram.com/sarasilkinMade entirely on Uisato Studio: https://uisato.studio/toolsMore experiments: https://linktr.ee/uisato
Go Slowly - [ft @ssilkin] | #cinematic #motion #choreography #klingai #midjourney #radiohead uisato 2026-01-02 | motion_ctrl / experiment nº1x sara silkin - instagram.com/sarasilkinmade entirely on: through: https://uisato.studio/more experiments, through: https://linktr.ee/uisato
ElevenLabs SFX - [TouchDesigner Component Release] | #touchdesigner #sfx #editing #ai #elevenlabs uisato 2025-12-23 | Available through: https://uisato.studio/toolsThis TouchDesigner component lets you generate high-quality sound effects directly inside TD using the ElevenLabs Sound Generation API, then automatically downloads and plays them in your network with a clean, one-button workflow.Demo: What it does:- Text-to-SFX generation inside TouchDesigner: type a short sound prompt (e.g., “a river flowing”, “metallic impact”, “distant thunder”) and generate audio instantly.- Automatic download + playback: the generated sound is saved to disk and immediately routed into an Audio File In CHOP → Audio Device Out chain for playback.- Duration control: set the requested generation length (great for one-shots or longer textures).- Prompt influence: adjust how strongly the model adheres to the prompt (from subtle interpretation to more literal).- Loop option for ambiences: a dedicated loop toggle designed for beds/textures (drones, room tone, wind, etc.).- Auto-save outputs: each generation is stored in your chosen folder with unique filenames, making it easy to build a library of SFX while you work.- TD-friendly parameters: designed to be triggered by pulses/automation, so it’s ready for interactive installations, generative performances, and real-time systems.
PLATONIC SPACE uisato 2025-12-16 | A short film inspired by @drmichaellevin's work on morphogenesis and Platonic space.You are, right now, a walking "negotiation" of trillions of beings collaborating, deciding what “you” become from one moment to the next. What is the “self” then, other than a temporary "deal"?Made entirely on: https://uisato.studio#aftereffects #film #cinematic #midjourney #premiere
OSCILLOSCOPES - #touchdesigner #oscilloscope #aftereffects #premiere #edit #ableton uisato 2025-12-08 | Technique consisting in experimental custom digital oscilloscopes, later intervened through various techniques using TouchDesigner + After Effects [Dehancer + Saphire Suite]More experiments, project files, and tutorials, through: https://uisato.studio/tools
SURVEILLANCE [V2] uisato 2025-12-01 | More experiments, assets, and various project files, through: https://uisato.studio/tools#shortfilm #surveillance #drone #aftereffects #musicvideo
[Release] Realtime Audioreactive Time Remap - [TouchDesigners Twixtor Clone] | #touchdesigner uisato 2025-11-30 | I came accross this viral video in which an expensive After Effects plugin was used [Twixtor]. After a few tries, I was able to replicate results using TouchDesigner and Flowframes.You can freely access the project files through: https://uisato.studio/tools#aftereffects #premiere #editing #video #effects
Realtime Audioreactive Time Remap - [TouchDesigners Twixtor Plugin Clone - Free Project Files] uisato 2025-11-27 | I came accross this viral video in which an expensive After Effects plugin was used [Twixtor]. After a few tries, I was able to replicate results using TouchDesigner and Flowframes.You can freely access the project files through: https://uisato.studio/tools#touchdesigner #aftereffects #design #editing #premiere
NOCTURNE uisato 2025-11-24 | Made entirely using: through: https://uisato.studio/#midjourney #google #shortfilm #film
A WAR ON BEAUTY uisato 2025-11-16 | "A war on beauty" - [Extended Cut]Made entirely on Uisato Studio: https://uisato.studio/toolsMore experiments, through: patreon.com/uisato
[WIP] Music Video Generator | A New Orchestration AI System uisato 2025-11-12 | New orchestration engine [WIP]Here, a preview of one of its modes: "music-video".Input: image [artist] + audio trackOutput: a modest video clip.Around 12 minutes of generation time / multi-GPU [H100s].Already available through: https://uisato.studio/#klingai #aimusic #ai
Surveillance [Nº1] - #touchdesigner #midjourney #experimental #python #klingai uisato 2025-10-21 | Made entirely on: through: https://uisato.studio/
[Release] Sora-2 Video Generator for TouchDesigner - #touchdesigner #sora2 #ai uisato 2025-10-14 | Featuring: - Text-to-video & Image-to-video- 16:9 & 9:16 (720p/1080p)- Negative prompt + optional seed- Async auto-download + auto-playback- PDF setup guide includedThree one-prompt commercials, one heroic banana 🍌Project files + component + full prompts → patreon.com/c/uisato
KRAR uisato 2025-10-10 | [ft. @Mstphano - Edit + SFX]A final movement for TRIBES, a six-film cycle. Created with deep respect for African traditions.Dedicated to the original keepers of memory, tradition, rhythm, and fire. Guardians of difference in an increasingly homogeneous world.Made entirely on Uisato Studio: https://uisato.studio/#klingai #horror #documentary
On-AI-R #1: Camille - Complex AI-Driven Musical Performance uisato 2025-09-30 | A complex AI live-style performance, introducing Camille. In her performance, gestures control harmony; AI lip/hand transfer aligns the avatar to the music. I recorded the performance from multiple angles and mapped lips + hand cues in an attempt to push “AI musical avatars” beyond just lip-sync into complex performance control.Tools: TouchDesigner + Kinect V2 + Ableton Live + Antares Harmony Engine → UDIO (remix) + ElevenLabs → Ableton again | Midjourney → Kling → Runway Act-Two (lip/gesture transfer) → Adobe (Premiere/AE/PS). Also used Hailou + Nano-Banana.Not even remotely perfect, I know, but I really wanted to test how far this pipeline would allow me to go in this particular niche. WAN 2.2 Animate just dropped and seems a bit better for gesture control, looking forward testing it in the near-future. Character consistency with this amount of movement in Act-Two is the hardest pain-in-the-ass I’ve ever experienced in AI usage so far. [As, unfortunately, you may have already noticed.]On the other hand, If you have a Kinect lying around: the Kinect-Controlled-Instrument System is freely available as of today. Kinect → TouchDesigner turns gestures into MIDI in real-time, so Ableton can treat your hands like a controller; trigger notes, move filters, or drive Harmony Engine for stacked vocals (as in this piece). You can access it through: https://uisato.studio/tools or full tutorial at: youtube.com/watch?v=vHtUXvb6XMM #touchdesigner #ableton #shortfilm #liveperformance #ai
RAKTA [ft. @Mstphano] - #klingai #midjourney #hailouai #film #horror uisato 2025-09-25 | Made entirely on: through: https://uisato.studio/
[Release] VEO-3 Video Generator - TouchDesigner Component | #touchdesigner #ai #generativeai #vj #dj uisato 2025-09-20 | VEO-3 Video Generation is now available inside TouchDesigner, featuring:- Support for both text-to-video and image-to-video.- Vertical and landscape, 720p and 1080p.- Negative prompt + optional seed for repeatability.- Automatic (async) auto-download and playback.- Includes 2 quick PDFs: Patch Setup (Gemini API key + 2 deps) and Component Guide.Project file, and more experiments, through: https://uisato.studio/tools
⟆ ⊹ TRIBE ⊹ - ［Ⅳ - ᛋᚨᚲᚱᛁᚠᛁᚲᛖ］| #hailouai #documentary #shortfilm #film #africa uisato 2025-09-08 | Made entirely through: https://uisato.studio/
tʀɪße_∞ : [3] - #hailouai #ai #shortfilm #shorts uisato 2025-09-02 | Made entirely through: https://uisato.studio/tools
⟆ - tʀɪße_∞ : [2] - #hailouai #cinema #tribal uisato 2025-08-12 | Made entirely through: https://uisato.studio/tools
![[Tutorial] Movement Controlled Instruments – TouchDesigner, Ableton Live and Kinect](https://i.ytimg.com/vi/vHtUXvb6XMM/hqdefault.jpg)