Hand Tracking in TouchDesigner - Master Class Part 1 Torin Blankensmith 2025-02-18 | In this first tutorial in a 3 part series, we’re taking a deep dive into hand tracking using the MediaPipe plugin for TouchDesigner. I’ll walk you through setting up hand tracking, smoothing data, building a custom clamp math component, and extending functionality with distance calculations for more accurate and interactive experiences.This is Part 1 of a multi-part series—check out the next tutorial here: [youtu.be/XRw1AUa57Zw]📌 Resources & Links:- Patreon (Download the final project file) – [patreon.com/blankensmithing]- MediaPipe Plugin for TouchDesigner – [github.com/torinmb/mediapipe-touchdesigner]- Previous MediaPipe Tutorial (Full breakdown of tracking features) – [youtube.com/watch?v=Cx4Ellaj6kk]The MediaPipe plugin for TouchDesigner is co-created by myself and Dom Scott @domscottartYou can check out Dom's work here:Website: domscott.caInstagram: @domscott.artLooking forward to seeing what you create! 🎉 Let me know in the comments if you have any questions.0:00 Intro & Overview 1:04 Project Setup & MediaPipe Plugin 3:38 Importing & Configuring Hand Tracking 7:20 Smoothing & Stabilizing Tracking Data 8:21 Custom Remapping with Clamp Math 13:08 Extending Hand Tracking & Gesture Controls 16:37 Outro & Next Steps
Object Tracking in TouchDesigner with MediaPipe + Audio in Ableton. Blob Tracking Style Effect Torin Blankensmith 2025-06-26 | In this beginner-friendly tutorial, we dive into object tracking with the MediaPipe plugin for TouchDesigner—no paid license required! You’ll learn how to connect a webcam or custom video input using NDI, visualize tracked objects with custom lines and bloom effects, and generate sound both through real-time audio buffers and MIDI note output to Ableton.📌 Resources & Links🔗 MediaPipe Plugin for TouchDesigner – [github.com/torinmb/mediapipe-touchdesigner]🔗 Full Project File – Available on Patreon – [patreon.com/posts/object-tracking-132384102]🔗 NDI Tools – [ndi.video/tools]🔗 MIDI Routing Windows Setup (LoopMIDI) – [https://www.tobias-erichsen.de/software/loopmidi.html]🔗 Previous MediaPipe Tutorial (Full breakdown) – [youtube.com/watch?v=Cx4Ellaj6kk]0:00 - Intro & Object Tracking Overview2:12 - Installing MediaPipe, NDI & MIDI Tools4:47 - Routing Video Input with NDI7:26 - Customizing Object Visuals (Lines, Threshold, Bloom)13:58 - Real-Time Audio from Visuals (Stereo Buffer)21:51 - Configure Midi Routing Mac + PC24:45 - Ableton Setup & Sound Design Techniques34:00 - Final Tips & Project File Access
What does video sound like? Torin Blankensmith 2025-04-24 | Having fun experimenting with piping the video feed into the audio buffer. This opens up some fun potential for using shaders on the GPU to create audio effects. The line in the middle is visualizing the audio being sent to your speakers. Currently, it’s reading the middle strip of pixels. Let me know what other visual effects I should try out on the audio. Running in real-time with #touchdesigner
Watercolor Hand Tracking Brush in TouchDesigner Tutorial Torin Blankensmith 2025-03-12 | In this beginner tutorial, we'll dive into hand tracking with MediaPipe and building an interactive watercolor effect in TouchDesigner! You'll learn how to create a custom hand-tracked brush to paint dynamically on screen, with brush size control, gesture-based clearing, and even video textures as brushes.📌 Resources & Links:- Clamp Math Component (Free Download) – [patreon.com/posts/clamp-math-tox-123882886]- Full Project File – Available for Patreon supporters – [patreon.com/posts/watercolor-hand-124232121]- MediaPipe Plugin for TouchDesigner – [github.com/torinmb/mediapipe-touchdesigner]- Previous MediaPipe Tutorial (Full tracking breakdown) – [youtube.com/watch?v=Cx4Ellaj6kk]- 3-Part Hand Tracking Masterclass – [youtube.com/watch?v=e2FtkufeErY&list=PLgfxkm9xFocaQXGTxu7HlFomE05kPbO8z]The MediaPipe plugin for TouchDesigner is co-created by myself and Dom ScottCheck out Dom's work:Website – [domscott.ca]Instagram – www.instagram.com/domscott.art0:00 Intro & Watercolor Brush Demo1:30 Project Setup & MediaPipe Plugin4:00 Basic Hand Tracking Output8:26 Mapping Hand Position to Brush Stroke13:12 Adding Feedback for Continuous Drawing18:35 Incorporating Video Textures into the Brush24:15 Creating a Watercolor Effect with Displacement & Blur26:40 Final Adjustments & Performance Mode
Generative Architecture and Hand Tracking in TouchDesigner with MediaPipe Torin Blankensmith 2025-03-04 | In this tutorial, we'll create a Brutalist-inspired Generative Architecture piece using TouchDesigner. We’ll explore instancing, physically based rendering (PBR), and hand tracking with MediaPipe for interaction.Looking forward to seeing what you create! 🎉 Let me know in the comments if you have any questions.📌 Resources & Links:- Patreon (Download the project file + bonus dithering plugin) – [patreon.com/blankensmithing]- Hand Tracking Masterclass (3-Part Series) – [youtube.com/watch?v=e2FtkufeErY&list=PLgfxkm9xFocaQXGTxu7HlFomE05kPbO8z]- Derivative TouchDesigner Fundamentals Course – [learn.derivative.ca]- ShaderToy Dithering Examples – [shadertoy.com/results?query=dither]- Dom Scott’s Work – Website: [domscott.ca] | Instagram: [instagram.com/domscott.art]0:00 Intro & Project Overview2:42 Setting Up the Project & Hand Tracking Integration4:30 Instancing & Physically Based Rendering (PBR)7:01 Applying Concrete Textures & Normal Maps10:30 Interactive Block Motion Using Noise & Rotation14:15 Implementing Hand Rotation to Cycle Forms18:02 Adding Animated Lights & Shadows for Depth22:35 Dithering Shader Effect25:20 Final Tweaks & Customizing the Interaction28:40 Outro & Next Steps
Hand Tracking in TouchDesigner - Master Class Part 3 Torin Blankensmith 2025-02-18 | In this final tutorial in a 3 part series, we’re taking a deep dive into hand tracking using the MediaPipe plugin for TouchDesigner. I’ll walk you through setting up hand tracking, smoothing data, building a custom clamp math component, and extending functionality with distance calculations for more accurate and interactive experiences.📌 Resources & Links:- Patreon (Download the final project file) – [patreon.com/blankensmithing]- MediaPipe Plugin for TouchDesigner – [github.com/torinmb/mediapipe-touchdesigner]- Previous MediaPipe Tutorial (Full breakdown of tracking features) – [youtube.com/watch?v=Cx4Ellaj6kk]Check out the previous tutorials here: Part1: youtu.be/e2FtkufeErYPart2: youtu.be/XRw1AUa57ZwThe MediaPipe plugin for TouchDesigner is co-created by myself and Dom Scott @domscottartYou can check out Dom's work here:Website: domscott.caInstagram: @domscott.artLooking forward to seeing what you create! 🎉 Let me know in the comments if you have any questions.0:00 Intro & Overview 0:27 Recording Hand Tracking Data 3:36 Setting Up High-Quality Playback 7:16 Creating Custom Visual Effects 9:41 Displacing Text with Video 12:26 Audio Effects & Hand Tracking Control 15:01 Time Machine Effects16:46 Finalizing & Exporting the Project 17:50 Outro
Hand Tracking in TouchDesigner - Master Class Part 2 Torin Blankensmith 2025-02-18 | In this 2nd tutorial in a 3 part series, we’re taking a deep dive into hand tracking using the MediaPipe plugin for TouchDesigner. I’ll walk you through setting up hand tracking, smoothing data, building a custom clamp math component, and extending functionality with distance calculations for more accurate and interactive experiences.This is Part 2 of a multi-part series—check out the next tutorial here: [youtu.be/XRw1AUa57Zw]📌 Resources & Links:- Patreon (Download the final project file) – [patreon.com/blankensmithing]- MediaPipe Plugin for TouchDesigner – [github.com/torinmb/mediapipe-touchdesigner]- Previous MediaPipe Tutorial (Full breakdown of tracking features) – [youtube.com/watch?v=Cx4Ellaj6kk]The MediaPipe plugin for TouchDesigner is co-created by myself and Dom Scott @domscottartYou can check out Dom's work here:Website: domscott.caInstagram: @domscott.artLooking forward to seeing what you create! 🎉 Let me know in the comments if you have any questions.0:00 Intro & Overview 0:28 Setting Up Hand Tracking UI 3:32 Selecting & Rendering Key Hand Points 7:16 Building a Custom Interface Component 12:26 Aspect Ratio Adjustments & Rendering 17:58 Gesture-Based Triggers & UI Feedback 22:19 Dynamic Labels & Gesture-Activated Text 25:14 Outro & Next Steps
Your Comment Becomes the Video: YouTube Plays Diffusion Torin Blankensmith 2025-02-14 | This is a social experiment using the live chat from YouTube with Stream Diffusion to generate an ever changing video. Additionally controll the underlying animation, zoom and speed by adding values in with your description. eg: nebula animation 15 zoom .5 speed 3For this project I'm using TouchDesigner and @dotsimulate 's real-time diffusion plugin. I do not own the rights to any of the content in this video and am not liable for the contents of the video.This project was inspired by Peter Whidden's earlier project using Stable Diffusion.
#Genuary Day 29 Prompt: Grid-based graphic design. #touchdesigner Torin Blankensmith 2025-01-31 | ...
#Genuary Day 27 Prompt: no randomness or noise or trig. #touchdesigner Torin Blankensmith 2025-01-29 | ...
#Genuary Day 25 Prompt: One line that may or may not intersect itself. #touchdesigner Torin Blankensmith 2025-01-27 | ...
Day 21 Prompt: Create a collision detection system (no libraries allowed). #touchdesigner #glsl Torin Blankensmith 2025-01-23 | ...
MediaPipe plugin for #TouchDesigner supports ControlNet OpenPose for Stream Diffusion Torin Blankensmith 2025-01-22 | ...
Genuary Day 18 Prompt: What does wind look like? Using @JosefPelz fluid solver. #touchdesigner Torin Blankensmith 2025-01-19 | ...
#genuary Day 14 Prompt: Pure black and white. No gray. #touchdesigner #shaders Torin Blankensmith 2025-01-15 | ...
#genuary Day 12 Prompt: Triangles and nothing else. #touchdesigner Torin Blankensmith 2025-01-14 | ...
#genuary Day 11 + 12: Try something that feels impossible for you to do) | Subdivide #touchdesigner Torin Blankensmith 2025-01-13 | ...
#Genuary Day 10 Prompt: You can only use TAU in your code, no other number allowed Torin Blankensmith 2025-01-11 | ...
#genuary Day 9 Prompt: The textile design patterns of public transport seating. #touchdesigner Torin Blankensmith 2025-01-10 | ...
#genuary Day 8 Prompt: Draw one million of something. #touchdesigner #owenwilson Torin Blankensmith 2025-01-09 | ...
#genuary Day 6 Prompt: Make a landscape using only primitive shapes. #touchdesigner Torin Blankensmith 2025-01-07 | ...
#genuary Day 3 Prompt: Exactly 42 lines of code. Made with Shader Park #touchdesigner #codingart Torin Blankensmith 2025-01-04 | ...
#genuary Day 2 Prompt: Layers upon layers upon layers #touchdesigner Torin Blankensmith 2025-01-04 | ...
#Genuary Day 1 Prompt: Vertical or horizontal lines only. #TouchDesigner Torin Blankensmith 2025-01-02 | ...
Immersive Memory with TouchDesigner and Ableton Torin Blankensmith 2024-11-18 | I’m excited to share Immersive Memory, an interactive experience set in AlUla’s Old Town, a UNESCO World Heritage site with a rich history in incense trade.This installation spans three distinct spaces, tied together by a spatial audio score by @mattfaddymusic. Each chapter invites visitors to engage with unique visuals inspired by incense, brought to life through physical interactions.It was a fun challenge to design the system to run for six months, distributing it across multiple servers while experimenting with particle systems, LIDAR tracking, and spatial audio using TouchDesigner and Ableton. Really excited to see it all come together!I had an amazing time collaborating with this talented team:Creative Direction: @martinamargauxProject Lead: @ai_iul_iaProject by: @aimes.artThanks to @numberwano for being a model in the video and for all the help with the physical install!Also, huge thank you to @function.str for the LIDAR calibration toolkit and pointers!
Easily Make Shaders in TouchDesigner: New Shader Park Plugin for TouchDesigner with T3D Support Torin Blankensmith 2024-08-11 | In this tutorial we'll go over the new Shader Park plugin for TouchDesigner. It allows you to easily take your raymarched shaders that run in the browser and bring them natively into TouchDesigner to introduce things like audio reactivity, hook them up to sensors, or render out high quality video. The plugin now supports occluding with other objects, soft shadows, and the ability to easily scale the objects up and down in TD.The new plugin also features support for Josef Pelz's T3D operators.Link to Shader Park: shaderpark.comLink to Download the plugin: github.com/shader-park/shader-park-touchdesignerBeginner Tutorial Series: youtube.com/playlist?list=PLgfxkm9xFocbc6wiO3A8vXalP4K57yUKoJosef's Patreon for T3D: patreon.com/JosefPelzPete’s youtube: youtube.com/@peterwhiddenPete’s Github: github.com/PWhiddyTorin's Patreon: patreon.com/blankensmithing0:00 Overview and Examples 3:28 Getting Started with the Plugin6:32 Overview of Signed Distance Fields9:38 Uniforms | Bring External Inputs into the Shader11:55 Changing Lighting Properties13:53 Using T3D with Shader Park
Visuals for @epicycle’s new track with Shader Park and TouchDesigner Torin Blankensmith 2024-08-09 | ...
New artwork from my residency in Rome using Neural Cellular Automata Torin Blankensmith 2024-07-10 | ...
