TouchDesigner
Widgets Part 1: Introduction - Panel Layout and Fill Mode
updated
----
Guest:
Daniel Molnar aka Function Store
https://linktr.ee/function.str
----
derivative.ca
derivative.ca/inSession
----
Guest:
Ana Herruzo
anaherruzo.com
vimeo.com/anitazk
----
derivative.ca
derivative.ca/inSession
----
Guest:
Darien Brito
darienbrito.com
instagram.com/darien.brito
vimeo.com/darienbrito
----
derivative.ca
derivative.ca/inSession
----
Guest:
Tommy Etkin
t3kt.net
instagram.com/t3kt
vimeo.com/tekt
----
derivative.ca
derivative.ca/inSession
----
Guest:
Matthew Biederman
mbiederman.com
instagram.com/matthewbiederman
vimeo.com/mbiederman
----
derivative.ca
derivative.ca/inSession
----
Guest:
Sahar Homami
saharhomami.com
sahar.bandcamp.com/music
instagram.com/sahar.homami
----
derivative.ca
derivative.ca/inSession
----
Guests:
David Braun
https://dirt.design/portfolio/
GitHub: github.com/DBraun
Ge Wang
https://artful.design
----
derivative.ca
derivative.ca/inSession
----
Guest:
Josef Luis Pelz
josefluispelz.com
Instagram: josefluispelz
----
derivative.ca
derivative.ca/inSession
----
Guest:
Rob Bairos
derivative.ca
github.com/lodefmode
----
derivative.ca
----
Guest:
Noel Apitta
scarletmotiff.com
Instagram: @scarletmotiff
instagram.com/scarletmotiff
----
derivative.ca
----
Guest:
Crystal Jow
crystaljow.com
Instagram: @crystaljowart
instagram.com/crystaljowart
----
derivative.ca
----
Guests:
Simone Franco
Luca Ferro
DragOn: drive.google.com/drive/u/2/folders/12F1DMxYTN9dnAJPM_VPggKkYEWLlN7wp
----
derivative.ca
----
Guest:
Noah Norman
https://hardwork.party
instagram.com/hardworkparty
----
derivative.ca
----
Guest:
Paola G. Olea
paoolea.com
instagram.com/pao.olea
----
derivative.ca
----
Guest:
Justin Dwyer & Dr Betty Sargeant
pluginhuman.com
instagram.com/pluginhuman
----
derivative.ca
----
Guest:
Caroline Reize
http://carolinereize.com
instagram.com/digital.rain
youtube.com/channel/UCxURnm2t_twX8wvazpfWEDA
----
derivative.ca
----
Guest:
Louise Lessel
http://www.louiselessel.com
----
derivative.ca
Example files: tinyurl.com/Summit2019GingerLeigh
0:00 - Introduction
3:35 - Notes on sensors
6:40 - MIDI controllers
26:06 - Thinking excercise
30:10 - Leap Motion
50:45 - See note below on additional excerpt video at this point
50:45 - Kinect sensors
1:13:55 - Ableton Live using Live Grabber
1:21:18 - Ableton Live TDAbleton
1:31:20 - Finishing remarks
At 50:45 in this workshop, we started experiencing audio problems in the recording for ~1 hour. The topic was OSC connections and intro to Kinect Studio Recorder. We have cut that part of the video out and made it available in this separate video if you are really eager to listen regardless of the audio problem. Thanks for your understanding.
Excerpt: youtu.be/AmReJwMXmHg
Workshop description:
In this workshop, participants will explore a number of creative methods, interfaces, and sensors for controlling live elements with TouchDesigner. Devices and features including MIDI controllers, Leap Motion, Kinect, Mi.Mu Gloves, as well as OSC and MIDI messaging protocols will be explored. Instructor, Synthestruct (aka. Ginger Leigh) will explain how TouchDesigner can employ these messaging protocols to communicate directly with Ableton Live in order to create visuals that respond to audio in Ableton, in real time. Participants will also receive tips for conceptualizing their ideas and optimizing their live control setup to reduce the risk of problems during a live performance.
After taking an in-depth look at several creative examples, workshop attendees will work together in pairs or small groups to create their own project using one or more of the control methods covered in the workshop.
Instructor: Ginger Leigh
Ginger Leigh (aka ‘Synthestruct’) is an interactive and audiovisual designer who works with sensors and data to create real-time, multi-modal installations and experiences that explore how we connect with and understand the world around us. Sound being a core topic of interest in her work, she explores ways of capturing the ‘personality’ of sounds through the reactive visuals she designs, and inversely uses the generative visuals she creates as inspiration in developing their accompanying soundscapes.
Recently she created two immersive fulldome audiovisual experiences that further explore the relationship between our auditory and visual perceptions in immersive environments, and how these elements are presented and manipulated in real time during live performance.
Website: http://www.synthestruct.com
----
Guests:
Manuel Mitasch
http://www.jonglissimo.com
Ben Kuper
http://benjamin.kuperberg.fr/chataigne/en
----
derivative.ca
Recommended Prerequisite: youtu.be/QtrzuSFfsSo
0:00 - Introduction
3:45 - Raymarching theory
15:23 - Let's start raymarching!
54:06 - Calculating Normals
1:16:50 - Combining shapes
1:29:55 - Adding interactive control with uniforms
1:35:05 - Inigo Quilez, Shadertoy, and using resources
1:43:37 - Displacement
1:59:14 - Experimentation and using the mod function
2:12:39 - Demo of the Montreal Summit branding project file
This workshop is focused in deepening the understanding of the GLSL language use cases within TouchDesigner. Basic Raymarching techniques will be covered, using shader programming to make the most out of your computer’s graphic processor. This workshops is intended for programmers with some knowledge of the graphics render pipeline.
Instructor: VanTa
VanTa is an experienced developer, with a strong focus in the field of computer graphics.
In his creations, he always tries to find a balance between geometry, abstraction, and chaos.
At the age of eight he left home and founded his own aerospace startup with very little venture capital, that operated from his parents’ porch.
With a background in environmental science, his work revolves around the intersection between art, science, and technology. He loves when digital elements align with the real world; either in augmented reality overlays, projection mapping on architectural landmarks, or pixels floating in thin air. VanTa also performs as a VJ and musician in different locations and festivals around the world. When he finds the time, he teaches coding to designers and artists.
Website: http://vanta.xyz/
Workshop: TouchDesigner Electronic Music Studio
Example Files: tinyurl.com/Summit2019-OwenKirby
0:00 - Introduction
3:30 - Audio synthesis in TouchDesigner
17:50 - EQs, filters, and effects
22:30 - MIDI and sequencing
27:43 - Audio recording and playback
31:14 - Troubleshooting
34:10 - Synth Builder Components - available here: owenkirby.net/components
41:40 - SuperSynth
52:20 - MonoSequencer
1:11:50 - Side topics
1:35:00 - Synth Builder Components
1:53:15 - Old audio-visuals
2:02:07 - LaunchControlXL Component
2:05:40 - Questions and exploring techniques
During this workshop participants will learn key techniques for putting together a complete electronic music and audio-synthesis workflow inside TouchDesigner through the use and study of several pre-built components. These will include midi sequencers, a polyphonic synthesizer, a drum-machine and sampler as well as various audio effects.Once participants are familiar with some of these basics, they will be given time to coordinate the development of an audiovisual jam/performance using these components and added functionalities.
Instructor: Owen Kirby
Owen Kirby is an audio-visual artist from Montreal, Canada with a background in science, film-making and electro-acoustic music composition. He studied cinema at Collège Champlain and went on to study electroacoustic music composition at Concordia University.
His love of electronic sound and real-time video workflows led him to spend time exploring the audio-synthesis side of TouchDesigner; discovering techniques and workflows which he documents and shares through his YouTube series: Electronic Ape Friends.
A keen biology enthusiast, he is in the process of proving the first partial albino morph of a local species of isopod and has created introductory myrmecology kits which have sold side by side with his TouchDesigner components on his Etsy store: StareIntoTheFire.
Website: owenkirby.net
GeoPix Example File: tinyurl.com/Summit2019-LucasMorgan
0:00 - Introduction
6:02 - GeoPix demo
15:14 - Anatomy of GeoPix - An object oriented lighting design sandbox
39:50 - The Editor Tab - Dataflow, static to real-time
51:56 - The I/O Tab - Recreating TouchDesigner, in TouchDesigner
58:56 - The Perform Tab - Allowing users to create modular VJ interface
1:05:38 - A balanced UI - Features vs speed vs aesthetic
1:19:50 - Optimization - The never ending quest for 60 FPS
1:41:41 - Node vs Code - Choosing wisely
1:46:16 - Final Touches - Bundling, python libs, installer
This session will feature a conversation about higher level principles and workflows. Much of the discussion will be based on challenges and solutions that were encountered throughout the development of GeoPix 1.0. Together the group will dive into a simpler isolated .toe file. Attendees can follow along to explore and see directly some of the issues and solutions for a variety of mock scenarios that can arise when programming large-scale projects.
Instructor: Lucas Morgan
Lucas is the creator of GeoPix, an LED/DMX Pixel Mapping software built in TouchDesigner.
His background is in 3D animation and rendering. He has spent many years building, texturing, and rendering 3D environments in software that includes Maya, Blender, 3ds Max, as well as composting software like Nuke and Composite. In the last five years Morgan shifted his focus to TouchDesigner, building pixel and video mapping projects both large and small for a variety of festivals including Electric Forest and Euphoria, and clients including Imaginex, BRDG, and MOD/OP Films.
His primary focus over the last three years has been around building large scale system architectures in TouchDesigner. His recent large scale projects include GeoPix 0.9, and Crescent Sun with Imaginex (on-going) and for the last year and a half, GeoPix 1.0 which was built from the ground up around a true 3D real-time workflow.
Example Files: github.com/MXZEHN/TD_WRSHP_BHS_Montral_8-19
1:37 - Stefan Kraus / The Node Institute Berlin
5:17 - Bauhaus
44:19 - TouchDesigner Basics
1:46:25 - 1 FarblichtSpiel
3:07:45 - 2 Clock
4:01:14 - 3 Replicator
5:07:07 - 4 LED
When Walter Gropius founded the legendary design school Bauhaus one hundred years ago in the German town of Weimar, the world had been turned upside down. Industrialization had severely changed people's everyday lives and WWI had shown the brutal potential of these new technologies. At this time, design and architecture had been struggling to find a new language that was appropriate for these radically changing means of production. In this fragile situation the architect Walter Gropius managed to gather some of the finest artists and designers of his era and founded a new school where art and design were taught in a completely new way.
How could the Bauhaus achieve this? With the Bauhaus Manifesto, Gropius took inspiration from the idea of the Bauhütte, the mystical design studio of the ancient cathedrals, where all crafts were united to make one holistic vision come to life. At the same time, students of the Bauhaus were encouraged to take matters into their own hands. In different workshops they were free to experiment with craft techniques and as a result produced a range of experimental works. This approach allowed students and masters to quickly overcome traditional thinking about form, color, and space and extract from this creative exploration what would come to be known as the International Style, the first global design language that continues to shape our reality today.
One hundred years later, we find ourselves in a similar situation. New technologies demand new design solutions yet specialization will not necessarily lead us down the right path. Much like the Bauhaus dreamed of art, life, and craft as a holistic gesamtkunstwerk (total work of art), working with TouchDesigner allows us to integrate all art disciplines into one experience that permeates both the real and the virtual.
In an homage to the early Bauhaus, instructor Stefan Kraus will guide workshop participants through five exercises, that speculate on how five famous Bauhaus masters would have used TouchDesigner to implement their ideas and teachings.
Instructor: Stefan Kraus
The work of Berlin-based VJ artist and director Stefan Kraus (aka ‘Studio MXZEHN’) explores the fusion of media, space, and performance. Emerging from East Germany's vivid electronic music scene, his work has moved beyond the experimental club environment and into the world of art exhibitions, media festivals, and theatre performances across Europe. Studio MXZEHN’s visuals are not a collage of prefabricated loops but the live performance of a custom-built, generative visual instrument.
Parallel to his artistic career Kraus has been teaching interaction design at the Bauhaus-University in Weimar where he co-founded the Genius Loci Weimar Festival, an annual competition for architectural projection mapping. Today, more than ever, Kraus is driven by the idea of the gesamtkunstwerk - an artistic vision that completely immerses the audience.
Website: http://www.mxzehn.de/
Starting Project: tinyurl.com/ycgz2763
Completed Project: tinyurl.com/y2r6jt7m
TouchDesigner 2020.25380+ required
TouchDesigner mapping tools mentioned at 00:42
Alphamoonbase's Galileo Mapper Family - derivative.ca/p/62142
Emintzer's Bridgets - derivative.ca/p/62577
Example Files: github.com/lachose1/wiimoteCHOP-cleanbase
This workshop is an introduction to the world of C++ CHOP programmed specifically for TouchDesigner. At the beginning of this workshop participants will gain an understanding of the custom C++ CHOP example source code while reviewing its main accessible methods.
Afterwards the group will review the design of a very simple module that will allow us to send data to TouchDesigner through the CHOP we will have created. At this stage participants will tackle the heart of a common problem together: the integration of a special sensor for TouchDesigner.
The presenters will demonstrate how to pair the Visual Studio debugger with TouchDesigner, how to use it, how to communicate with the sensor, and then how to send the data into TouchDesigner without causing any threading problems. By the end of this session attendees will have a global view of the design of a CHOP module in C++.
Unfortunately, this workshop is mainly intended for participants using Windows (because of the emphasis on Visual Studio and the instructor’s experience with this operating system). An advanced Mac OS X user with a solid knowledge of C++ could also join the workshop.
Instructor: Hugo Laliberté
Hugo Laliberté is a creative programmer in the field of interactive and experiential digital art. He currently co-directs the Ottomata Montreal Experiential Studio, which specializes in the technical design of interactive installations and immersive works. Laliberté develops his works around the spectator and the capacity to act. With a background in electrical engineering, advanced programming, and music, he began experimenting with interactive media in 2013 and obtained a Bachelor's Degree from the Université du Québec à Montréal. It was at this time that he co-founded his first artist collective with which he exhibited at the Chromatic Festival, the Society for Arts and Technology, the Livart Gallery, and the Jutra Awards Gala. His work has been featured across Canada, Dubai, and Tokyo.
Website: http://ottomata.com
Example Files: tinyurl.com/Summit2019-SimonAlexanderAdams
This workshop will walk participants through the process of creating real-time generative visuals using two types of systems: reaction-diffusion and cellular automata. Both methods yield a variety of complex and often non-repeating patterns.
Reaction-diffusion systems model the changing of one or more chemical substances. The examples that will be addressed in the workshop include beginner level TOP-based methods and a brief discussion of intermediate level techniques using GLSL. Cellular automata are simulations consisting of grids of cells which change their state based on simple rules. Participants, along with the instructor, will build 1D and 2D cellular automata systems from scratch using GLSL and will look at examples which incorporate decaying cells (or the “generations” variation) along with methods for utilizing multiple rule-sets in one system.
These patterns, while compelling on their own, can also be used as the input to other systems. This session will help participants understand how to use their motion to drive particles systems and manipulate geometry, in addition to exploring how to add interactive elements to these systems, such as audio-reactivity and motion control from a Kinect or Leap Motion. Above all, the workshop will expose participants to an iterative approach to creating generative visuals, exploring ways of reusing concepts and techniques in new ways.
Instructor: Simon Alexander-Adams
Simon Alexander-Adams is a multimedia artist working within the intersection of music, visual art, and technology. He directs multimedia performances that connect sonic, visual, and kinetic forms, creates interactive installation art, designs new interfaces for musical expression, and produces generative animations and audiovisual works. His work has been presented at international festivals, including Electric Forest, the Ann Arbor Film Festival, and the 2018 Bi-City Biennial of Urbanism/Architecture Shenzhen.
Alexander-Adams has also composed music for short films, theatrical, and dance performances, and performs regularly with the art-rock band saajtak, which has performed at Sonic Circuits (D.C.), Strange Beautiful Music (Detroit), and has shared the stage with musical artists such as Xiu Xiu, Gaelynn Lea, Vicky Chow, New Music Detroit, Laurie Amat, Alan Licht, and more. He received an MA in Media Arts in 2015 from the University of Michigan, School of Music, Theatre & Dance.
Website: https://www.simonaa.media/
----
Guest:
Ginger Leigh
synthestruct.com
instagram.com/synthestruct
----
derivative.ca
----
Guest:
Elburz Sorkhabi
(interactiveimmersive.io)
Ori Ben-Shabat
Dylan Roscover
(theexperiential.com)
----
derivative.ca
Example Files: tinyurl.com/Summit2019GBourassa
00:00 Discussion of previous works and older tape mapping system
29:18 Tapping Mapping workshop begins
Since its invention in 1925 by M. Richard Gurley Drew (3M - Scotch), adhesive tape has become a medium of choice for a large number of artists. From the replacement of paint and colored glass to its own more contemporary style of tape art with projection aka : Tape Mapping. Tape art already sticks to the walls of several major international art galleries and museums. This workshop will be an introduction to this medium, its history, its contemporary applications and finally Guilllaume Bourassa's own artistic approach with the sticky ribbon.
Participants will explore the Kantan Mapper .tox that is already included in palette of TD99, which allows, amongst other things, to generate ''Tape Mapping'' type installations. Then it will be taken one step further and control of the content through the use of Python and an Android tablet with TouchOSC will make the project interactive. The end of the workshop will allow participants to create a collective work with the tape based on a pattern created by artist ThisIsNotDesign [TiND].
Instructor: Guilllaume Bourassa
Guillaume Bourassa is the Co-founder of Creation Ex Nihilo and works in new media creation and specializes in immersive and interactive video, mapping, Tape art and 3D. After several years as technical head of Satosphère at the Society for Arts and Technology, he is now Director of Research and Development at Moment Factory, a world-renowned experiential design firm. He has more than 15 years of experience in digital arts and is constantly renewed thanks to his inexhaustible curiosity.
----
Guest:
Harvey Moon
harveymoon.com
Instagram: @moonharvey
mblabs.org
Instagram: @mb_labs
----
derivative.ca
----
Guest:
Harvey Moon
harveymoon.com
Instagram: @moonharvey
mblabs.org
Instagram: @mb_labs
----
derivative.ca
In this workshop participants will acquire a basic understanding of how GLSL shaders operate within TouchDesigner. Additional information around their syntax and common use will be reviewed. This will be achieved through the creation of two real-life projects (an analog style synthesizer and a 2D pattern generator). The instructor will be present to guide students throughout the process. The main concepts of the workshop will be discussed and demonstrated at the beginning of the class and the rest will present themselves as the class unfolds.
This workshop is intended for programmers that want to deepen their understanding of computer graphics, for designers that want to learn how things are made, and for anyone curious enough to see the way pixels are drawn on a screen. A basic understanding of programming is required. Some experience with computer graphics will be useful.
Instructor: VanTa
VanTa is an experienced developer, with a strong focus in the field of computer graphics.
In his creations, he always tries to find a balance between geometry, abstraction, and chaos.
At the age of eight he left home and founded his own aerospace startup with very little venture capital, that operated from his parents’ porch.
With a background in environmental science, his work revolves around the intersection between art, science, and technology. He loves when digital elements align with the real world; either in augmented reality overlays, projection mapping on architectural landmarks, or pixels floating in thin air. VanTa also performs as a VJ and musician in different locations and festivals around the world. When he finds the time, he teaches coding to designers and artists.
Website: http://vanta.xyz/
This workshop will focus on Multi GPU System Design, implementation and execution with a focus on stability, performance and simplicity. Participants will examine the inner workings of a custom multi-node playlist component (Fusion Player) that plays back a playlists of cues (either pre-rendered content files or real-time components) across multiple nodes (ie. GPU's and or servers). In the workshop, methods for communication, synchronization and configuration of each node in the network will be discussed along with various methods and techniques to keep performance high while at the same time maintaining high functionality along with high render quality.
TD-centric advanced Python and GLSL techniques used to maintain simplicity and speed will also be covered.
At the end of the workshop attendees should have a solid understanding of the requirements of implementing and executing a large scale system as well as an understanding of the data model flow of the Fusion Player component itself. They will also be able to keep the Fusion Player component for future use and reference.
Instructor: Keith Lostracco
Keith Lostracco started his career building and running his own music recording studio which gave him a broad range of skills not easily obtained in other situations. He has experience in everything from management to music production to computer graphics animation and programming to carpentry. In today’s world of media production, recording studio’s need to diversify in order to keep up with the changing time’s and technology. Realizing this early on Keith saw that video production and computer graphics programming in relation and reference to music was one of best ways to achieve this.
In a continued effort to collapse the gap between sonic, tactile, and visual systems, in this talk Dave & Gabe will present their approach to developing musical structures and environments. With a focus on leveraging a variety of sensor inputs, the presenters will show how TouchDesigner is central to the composition of their projects. They will demonstrate how the TDAbleton package can be used to drive visuals via MIDI and sounds from Ableton. Dave & Gabe will also explain how to send MIDI sequences out of TouchDesigner while controlling external synth and effects parameters. Every physical object imparts its own characteristics onto an interaction: resistance, momentum, texture. By using these unique qualities artists and designers can produce a range of natural hybrid sonic objects.
Presenters: Dave & Gabe
Dave & Gabe is an interactive installation studio that unites sound, light, and tactility in the creation of immersive experiences. They believe environments should be expressive. They encourage collaboration and the amplification of the energy within. Working as artists with various institutions and brands, they explore new directions in real-time animation, generative 3D sound, and physical design.
Website: https://www.daveandgabe.care/
Application of Kinetic Installation and Laser Control System in China
In this talk, Ruokun Chen and Jimmz Zhang will describe the technical development of various commercial projects using TouchDesigner, including kinetic installations and a laser control system.
The first project that will be addressed is a kinetic installation control system developed for launch events for both Audi and Volkswagen. Photo and video documentation will be shown in order to explain how this system works with pre-rendered video, real-time projection, and dance performances. This particular technique is based on DMX512 and Art-NET protocol. This presentation will also detail how the design team used GLSL to calculate 40k channels of DMX channels in real time for the Audi Launch in Guangzhou and the troubleshooting techniques they developed for the project.
Chen and Zhang will also discuss the laser control system that they integrated with the Audi A6L Launch in January 2019 and will share how they were able to make the system cooperate precisely in relation to a holography show.
A further technical discussion will describe and explain EtherDream and laser machine in connection to TouchDesigner. A further technical discussion will describe and explain how to control Lasers from within TouchDesigner using the Etherdream interface. The presenters will also elaborate on a tdu.Matrix based cornerpin correction that can be deployed for laser projections.
The talk will be brought together by a discussion of workflows for the development of control systems in addition to an overview of the technical specifications of different hardware and software. The presenters will display technical resources, including .toe files and animation FBX files, in order for attendees to better understand the concepts presented.
Presenters: Ruokun Chen
Ruokun Chen is the founder and CEO of Digital FUN (creative studio), as well as the President of the Chinese TouchDesigner Community. His studio has taken part in multiple large-scale projects including the Volkswagen CC Launch (Shanghai), the Audi A8L Launch (Hainan), the Lululemon “1000 People Yoga” event (Beijing), and the performance of The Curious Incident of the Dog in the Night-time (Vancouver). He has experience as a technical developer and a special effects designer.
In December 2018, Digital FUN organized the first TouchDesigner forum in Shanghai, which lasted seven days and included Ben Voigt, as well as many artists from Japan, Greece, and Russia. More than 7000 people attended the event.
Jimmz Zhang
Jimmz Zhang is a 3D visual artist and designer who graduated from the Centre for Digital Media in Vancouver, Canada. His projects contain lighting installation design, interactive art projection, VR experience and game art. Through working on various directions of digital media he explores the unlimited prospect of multiple realities.
By combining his undergraduate degree in environmental design with his interest in digital media he embraces vitality, creativity and innovation. He hopes to convey through his designs and artworks messages about the relationship between human and their surroundings, stimulating sensations from users while evoking their imaginations or emotions attached to a particular environment.
Website: Digital Fun - http://www.digitalfun.net
TEA - http://www.tea-community.com
TouchDesigner Chinese book: http://www.digitalfun.net/book
Starting Project: tinyurl.com/ycgz2763
TouchDesigner 2020.24520+ required
MIDI, OSC, and other inputs often come into TouchDesigner as CHOP channels. This workflow shows how to bind these channels to parameters anywhere in your project.
----
Guest:
Somil Metha
Instagram: @msomil
----
derivative.ca
----
Guests:
Akiko Yamashita
www.akikoyamashita.com
Aberration Lab launching May 27th
Twitter: @AberrationLab
www.twitch.tv/AberrationLab
----
Torin Blankensmith & Peter Whidden
www.torinblankensmith.com
www.peterwhidden.com
www.shaderpark.com
Twitter: @tblankensmith
Instagram: @blankensmithing
----
derivative.ca
AUDIO: We lost part of the audio at the beginning and had to use a backup source, primary audio restored at 14:23
The ‘Prime Directive’ of art (shamelessly borrowing this term from Star Trek) is to inspire, to shock, to disrupt, and to create an emotional connection and response unachievable by any other means.
That’s it. Nothing more.
But what if art could help materialize data or educational concepts to create a deeper and more visceral understanding of them that would go beyond our simple interpretation of charts? What if these concepts could be forever associated in one’s mind with a particular artwork or installation?
That is one of the many things we are trying to do in OVVO Live Art Studio. The concept of ‘purpose’ and the question of ‘why’ sound very old-fashioned, but we’ll be the first to admit to absolutely loving the answer ‘just because’, scientifically named the ‘beauty paradox of evolution’. Working in a commercial environment, we’re constantly confronted with justifying our choices in order to crystallize concepts front and center.
As an example for this special talk, I will betaking two of our latest projects that illustrate this idea of applied arts:
· Le Grand Paris Showroom – This is a very futuristic and sophisticated data visualization installation, heavily stylized to ‘transport’ the visitors into the Paris Metropole of 2030 and beyond. It was conceived as a mix of high-level concepts, key data and opportunities analysis aimed at inspiring suburban city authorities and key players around Paris to join the Metropole expansion. For this project, we developed a hybrid playback system that combines projection mapping, pixel mapping for pixel LED tapes, rings and underbelly lighting, as well as ambient light scenarios. All the data are encoded in one single movie file. Everything is controlled by our custom-made web app with a custom back-end CMS (content management system).
· Recycling Education Project – This is a small, one-day project that uses whimsical props and objects to introduce children to the concept of recycling. It is presented as six barcode machines with special cards containing a picture and a QR code. When the card is scanned over a recycling bin, light and sound will indicate if it is the correct, corresponding bin or not. And before you ask, yes, we used the round-robin sound sampling method to make sure the same sound is not repeated many times in a row, driving children (and us) insane. Kudos to the TouchDesigner team, especially Markus, for helping us fix a special case that used lots of Serial DATs.
Presenter: Shandor Chury
Shandor Chury was born in the Soviet Union and brought up in Belarus (Vitebsk and Minsk) in the general art school, specializing in piano. He has been deeply involved in music, as a classical piano performer, orchestrator and mixing engineer for long time and in various ways.
Coming to France to finish his Master Degree (languages, international relations, math, statistical analysis) he decided to come back to his true love – stage, performance – but in a different way. He created the brand OVVO to be able to do everything he wanted: music, lighting, stage design, programming, technical direction.
Working for more than 7 years in Technical Directions of big events and shows (Beyoncé, P!nk, Katy Perry…) in Europe, he then reoriented the company to content creation and live art entertainment, involving large scale mappings, show content, data visualization installations. It was (and still is)a unique opportunities to combine all of his skills into 1. TouchDesigner became his best partner in crime since then.
Website: http://www.ovvo.studio
Example Files: tinyurl.com/Summit2019-WielandHilker
Widgets are a new and exciting way to create highly customizable interfaces. Even though widgets can effectively reduce a creator’s workload it can still be hard to build big and complex interfaces by hand. In this workshop we will take a deeper look at ways of automating interface creation for the users themselves and for quick prototyping.
This workshop will outline widgets and binding and will address network organization using custom comps, external tox files, and OPShortcuts. Additionally, we will review network analysis and comps, learn how to create new functionality with the use of extensions, outline how to use drag and drop, take a deeper look into complex Python scripting with class-extension and error-handling, and master creating and recalling presets.
Instructor: Wieland Hilker
Born in Potsdam, Germany, Wieland Hilker (aka ‘Jonas Schmitt’) at one time found himself looking for an easy to use, free video playback software. After brushing off TouchDesigner, believing it to be too complicated, he kept returning to the platform, and finally realized the potential it holds. Nowadays he uses TouchDesigner as a base for MediaServer setups in a theater-environment to combine video playback and interactive elements. After moving to Berlin, he was drawn to the fields of electronic music and from there Belka was born bringing a fast performance tool built on the same freedom and modularity already used in theater setups.
Example Files: tinyurl.com/Summit2019-WielandHilker
Widgets are a new and exciting way to create highly customizable interfaces. Even though widgets can effectively reduce a creator’s workload it can still be hard to build big and complex interfaces by hand. In this workshop we will take a deeper look at ways of automating interface creation for the users themselves and for quick prototyping.
This workshop will outline widgets and binding and will address network organization using custom comps, external tox files, and OPShortcuts. Additionally, we will review network analysis and comps, learn how to create new functionality with the use of extensions, outline how to use drag and drop, take a deeper look into complex Python scripting with class-extension and error-handling, and master creating and recalling presets.
Instructor: Wieland Hilker
Born in Potsdam, Germany, Wieland Hilker (aka ‘Jonas Schmitt’) at one time found himself looking for an easy to use, free video playback software. After brushing off TouchDesigner, believing it to be too complicated, he kept returning to the platform, and finally realized the potential it holds. Nowadays he uses TouchDesigner as a base for MediaServer setups in a theater-environment to combine video playback and interactive elements. After moving to Berlin, he was drawn to the fields of electronic music and from there Belka was born bringing a fast performance tool built on the same freedom and modularity already used in theater setups.
----
Deep Kumar
audio reactive setups
----
Adrien Oneiga & Jiggs Love
Hooking up Avatars to Ableton
www.oneiga.com
www.thescantruck.com
In this talk Ronen Tanchum will demonstrate different ways to treat TouchDesigner as a 3D production package for the creation of high-end 360 content. He will focus on the different roles TouchDesigner can take in a traditional production pipeline, ranging from Previz, animation, on-set visualizations, 3D layout animation, shading, and rendering. Different ways of exporting 3D scenes and simulations from Houdini into TouchDesigner will also be explained. Tanchum will go into detail about how to approach large projects that don’t necessarily have the budget to go fully 3D and how they can be managed by arranging them into executable tasks for a small team. The presenter will describe how he utilizes TouchDesigner’s capacity to render in incredibly high-resolutions while saving disk-space, rendering time, and limiting turnaround time for clients. Finally, Tanchum will describe how TouchDesigner has assisted on projects in terms of computing power, accessibility, and flexibility.
Presenter:Ronen Tanchum
Ronen Tanchum is an artist and technologist working at the intersection of art, technology, and interaction. His work focuses on researching human perception in relation to art and technology. He conducts social experiments through his art pieces, creating a visual dialogue around the subject of digital art and its interventions within culture. He embraces the use of technology and mixes media art forms. He is the founder of Phenomena Labs, Artist & Technologies.
WARNING! - The beginning of this workshop has bad audio issues, please adjust volume accordingly. After 24:30 the issues are resolved.
Example files: tinyurl.com/Summit2019-MichaelMcKellar
This workshop is an exploration into projection warping with a focus on fulldome projection mapping. This session will benefit individuals with an interest in domes, projection, pixels, and immersive content playback. Time will be dedicated to understanding, designing, developing, and implementing usable fulldome mapping tools that will broaden participants’ horizons in terms of what can and cannot be done in the projection mapping world. Why pay for expensive software when you can do it yourself?
The first half of the day will explore the implementation of a 3D scene pre-visualization and the methods required to capture a dome correctly in order to to allow us to project back into one. The second half of the day will focus on re-projecting the captured content and manipulating the projected image to create the perfect mapped dome. By the end of this workshop users will have hands-on experience with from-scratch projection mapping skills, pixel mapping, manipulation tools and will hopefully come away with one mapped dome!
Instructor:Michael McKellar
Michael McKellar is a creative designer, instructor, and technologist. He has been involved with creative computing most of his professional life. He is currently an assistant professor within the School of Creative Design and Technology at the University of Texas in Austin. McKellar’s classes specialize in the methodologies surrounding the design and development of immersive technologies.
Professionally, he has designed, developed, and implemented immersive and interactive commercial work around the world for clients from fields that range from construction to realty and even royalty. His portfolio contains a large number of specialist projection and interactive mapping skills from CAVEs, immersive domes, and human computer interactivity.
He started Programming for People in 2016 to fill a gap in the online tutorial market that was not catering to interactive or creative outlets. It boasts in excess of 10,000 unique viewers each month studying a range of hardware, software, and creative computing implementations.
Website: http://www.michaelmckellar.co.uk
Since the early 2000’s performers have been incorporating livecoding into their practices. In 2011, events that combined livecoding with dance and algorithmic music called algoraves emerged. Generally, livecoding involves improvising sound and video by programming on the fly. This practice has many practical applications in all sorts of creative coding work even outside of the field of performance.
In this workshop, we’ll work with code that modifies TouchDesigner networks in real time through Visual Studio Code. Starting with a basic 3D render, we’ll build up generator and effect functions, talk about code structure, and finish with a larger interactive network. Participants will leave the workshop with the skills to understand TouchDesigner networks as functions and variables and will be comfortable with experimenting with this alternate way of interacting with TouchDesigner.
After the workshop, participants will be encouraged to seek out their local livecode groups and incorporate livecoding into their practice as a way to prototype larger projects that are still in development.
Instructor: Ulysses Popple
Ulysses Popple is a live visual artist who uses real-time coding to make projections. He's a member of livecode.nyc, a collective of musicians and artists who use code in their live performances. Popple specializes in solo or small team development for responsive, interaction-based experiences. He is an expert in selecting the most appropriate tools for the task and delivers projects within strict timeframes. His previous clients include, Saatchi & Saatchi, SAP, HBO, and the NBA. Based in New York City, his personal projects have been installed in New York City, Los Angeles, and New Orleans.
Our community’s approaches, tools, and techniques are increasingly valuable to clients connecting with their audiences through digital layers in physical places - from temporary experiential events & activations to permanent installations in architectural contexts.
This session will explore the “emerging field” that we are all working in and creating. Presenter David Bianciardi will share some perspectives from AV&C’s time working at this intersection of digital and physical.
Ecosystem: What is the landscape of interconnected disciplines we operate in? How are our contributions key to the success of this kind of work for our clients and partners? This work is a team sport - how do we fit into this ecosystem as individuals, groups and companies?
Deep Media: We define “media” and “content” to include responsive, data-driven, computationally generated, realtime visual expression. Why is traditional “linear” media not always optimal for these new types of canvases and how is “evergreen” or “deep” media the strategic approach? Why realtime?
Working at Scale: As our approaches go mainstream, how do we scale our techniques and ways of working together? How do we manage the risk of “new” (innovation) with the responsibilities of working in the built environment?
Presenter: David Bianciardi
David Bianciardi is the founder and principal of AV&C - a globally recognized experience design studio based in New York City that creates digital landmarks in the physical world.
AV&C’s interdisciplinary team of designers, technologists, engineers, software developers, and producers delivers software-driven experiential installations for forward-thinking clients seeking to foster deeper connections with their audiences in the built environment.
Bianciardi began his career as a musician, composer, and a sound designer and quickly found that using software and technology to make things talk to each other was useful in creating “designed experiences” and “connected places”. As clients started exploring their roles as storytellers and appreciating how we could help, the business came into being, along with an evolving art practice.
Website: av-controls.com
Example files: github.com/avc-choy/td-summit-2019
This workshop will focus on system design for large scale installations. Notably, the session will review the basics of setting up a standardized project environment in order to manage multi-machine installations. This includes config-based dynamic loading/protocols for development and production environments, file structure/directory conventions, code externalization, and git versioning.
Further, the workshop will cover best practices for handling data. Key concepts will include an extension-based philosophy for structuring your network and code for maximum efficiency, using inheritance and component compartmentalization to isolate functionality across your system, reusable parsing and data routing methods, decoupling functionality from interfaces, and general component and module organization.
Other key points that will be addressed in this session include methods for data visibility – such as using StorageManager and persistent data, extension properties, and setters/getters for efficient code handling as well as using operator dependencies and dependable objects for reliable network data inputs.
Lastly, the instructors will discuss essential optimization knowledge to keep large scale installations running at peak performance. These include items such as start-up procedures, data caching, raster re-mapping, and additional tips and tricks learned from real-world integrations.
Instructor: Colin Hoy
Colin Hoy is a Senior Software Developer working with AV&C in New York City. Colin has implemented many large scale, multi-machine installations with various flavors of systems design, control and interactivity.
Throughout these experiences he has become a strong believer in programming conventions and standardization to aid in the interoperability across not only projects, but developers as well. He sees often overlooked data concepts such as compartmentalization, storage and routing/handling as critical factors in fostering the development of modular, reusable project architectures that are scalable and nimble in adjusting to the demands of any project.
Example Files: tinyurl.com/Summit2019-QuentinBleton
This workshop aims to demonstrate a new way of manipulating SOPs in TOP space, while preserving optimized performances, by leveraging the GPU through geometry shaders to convert an SOP into, or from, a TOP. The geometry shader will be presented and explained first through a series of simple and practical examples, to illustrate its unique capabilities in comparison to vertex and pixel shaders, and how they may be used to accomplish our goal.
Using this knowledge, we will build a GPU accelerated tox responsible for converting an animated SOP into a series of TOPs, storing vertices attributes and connectivity that vary over time. Then another component will use those very TOPs to reconstruct the geometry by using another geometry shader.
Finally, we will explore how to generate, modify, and combine different geometries in TOP, leveraging the power of pixel shaders to do so. Some tools will be presented that show how to apply this technique to point cloud data or Kinect recordings.
Instructor: Quentin Bleton
Quentin Bleton works at Moment Factory as a Solution Architect. He has used TouchDesigner as a teaching platform, mostly for shaders. He is interested in using shaders to bypass traditional performance bottlenecks in TouchDesigner and finding creative, out of the box applications for shaders. He is particularly interested in the versatility of geometry shaders.


