- 97
- 123 075
Blake Marques Carrington
United States
เข้าร่วมเมื่อ 30 ก.ค. 2018
I'm a professor at Pratt Digital Arts in Brooklyn, and will be a Fulbright US Scholar in Brazil in Spring 2025 working in the transdisciplinary practice of art + technology. The first batch of tutorials I uploaded here (the first 65 videos or so) are from undergraduate & graduate level courses introducing the visual development environment TouchDesigner, the virtual Eurorack software VCV Rack, and other tools used by audiovisual artists interested in technology. Those are all largely beginner to intermediate level tutorials. More recent videos tend to explore more advanced techniques. Please subscribe and let me know what you think, thanks!
Setting up your system for StreamDiffusion TD
This video goes through the steps to prepare your computer to run the StreamDiffusionTD.tox created by @dotsimulate , a generative AI tool capable of real-time output of text2img and img2img content.
/////////////////////////////////////////////////////////////////////////
1) Can your computer run StreamDiffusion TD?
- Must be Windows PC with a CUDA-compatible NVIDIA GPU
- Check your GPU
(www.microsoft.com/en-us/windows/learning-center/how-to-check-gpu)
- Is that GPU CUDA compatible? Check this list: (developer.nvidia.com/cuda-gpus)
2) How to install the necessary components to make this work?
When installing Python, CUDA, and Git, if you see an option to “Add to system PATH” make sure you check it yes.
a) Python 3.10.9
(www.python.org/downloads/release/python-3109/)
b) CUDA Toolkit
(developer.nvidia.com/cuda-11-8-0-download-archive)
c) Visual Studio 2022 Community (need “Desktop environment with C++”) (visualstudio.microsoft.com/downloads/)
d) NDI SDK (ndi.video/for-developers/ndi-sdk/download/)
e) Git desktop client (git-scm.com/download/win)
f) TouchDesigner 2023 version (derivative.ca/download)
…
g) Have updated NVIDIA driver? (www.nvidia.com/download/index.aspx)
3) Are Python, CUDA, and Git in your PATH environment variable?
How to add Python to PATH
realpython.com/add-python-to-path/
Read the section “Manually Add git to the PATH on Windows”
www.delftstack.com/howto/git/add-git-to-path-on-windows/
/////////////////////////////////////////////////////////////////////////
Once you’ve done that, it should work! Watch dotsimulate’s tutorial (the developer of the StreamDiffusion TD tool) on how to get started (th-cam.com/video/X4rlC6y1ahw/w-d-xo.html)
Github repo of StreamDiffusion researchers (heavy CS content)
github.com/cumulo-autumn/StreamDiffusion
/////////////////////////////////////////////////////////////////////////
00:00 Overview
01:50 Check GPU
02:18 Check CUDA compatibility
03:23 Download Python
05:06 Check add to system PATH
05:32 Download CUDA
06:13 Download Visual Studio
07:05 Download NDI SDK
08:02 Download Git
09:10 How to add to system PATH environment variable manually
12:12 TD 2023 version required
12:34 Update NVIDIA driver
13:24 You're ready to go
/////////////////////////////////////////////////////////////////////////
1) Can your computer run StreamDiffusion TD?
- Must be Windows PC with a CUDA-compatible NVIDIA GPU
- Check your GPU
(www.microsoft.com/en-us/windows/learning-center/how-to-check-gpu)
- Is that GPU CUDA compatible? Check this list: (developer.nvidia.com/cuda-gpus)
2) How to install the necessary components to make this work?
When installing Python, CUDA, and Git, if you see an option to “Add to system PATH” make sure you check it yes.
a) Python 3.10.9
(www.python.org/downloads/release/python-3109/)
b) CUDA Toolkit
(developer.nvidia.com/cuda-11-8-0-download-archive)
c) Visual Studio 2022 Community (need “Desktop environment with C++”) (visualstudio.microsoft.com/downloads/)
d) NDI SDK (ndi.video/for-developers/ndi-sdk/download/)
e) Git desktop client (git-scm.com/download/win)
f) TouchDesigner 2023 version (derivative.ca/download)
…
g) Have updated NVIDIA driver? (www.nvidia.com/download/index.aspx)
3) Are Python, CUDA, and Git in your PATH environment variable?
How to add Python to PATH
realpython.com/add-python-to-path/
Read the section “Manually Add git to the PATH on Windows”
www.delftstack.com/howto/git/add-git-to-path-on-windows/
/////////////////////////////////////////////////////////////////////////
Once you’ve done that, it should work! Watch dotsimulate’s tutorial (the developer of the StreamDiffusion TD tool) on how to get started (th-cam.com/video/X4rlC6y1ahw/w-d-xo.html)
Github repo of StreamDiffusion researchers (heavy CS content)
github.com/cumulo-autumn/StreamDiffusion
/////////////////////////////////////////////////////////////////////////
00:00 Overview
01:50 Check GPU
02:18 Check CUDA compatibility
03:23 Download Python
05:06 Check add to system PATH
05:32 Download CUDA
06:13 Download Visual Studio
07:05 Download NDI SDK
08:02 Download Git
09:10 How to add to system PATH environment variable manually
12:12 TD 2023 version required
12:34 Update NVIDIA driver
13:24 You're ready to go
มุมมอง: 11 863
วีดีโอ
TouchDesigner to Arduino
มุมมอง 2.8Kปีที่แล้ว
This video follows up on the tutorial way back titled "Arduino to TouchDesigner (One-Way)" (th-cam.com/video/4dO7Q5oQbRg/w-d-xo.html), which showed how to get sensor data from an Arduino board into your TouchDesigner network. This time I focus on the other direction, sending control data from TD over to an Arduino board in order to control LED's, motors, etc. See also a recent tutorial titled "...
Control 120V Electronics w TD + Relay Switch + Arduino
มุมมอง 2Kปีที่แล้ว
This video shows the basic principles and techniques of how to use an TouchDesigner, an Arduino microcontroller, and a relay module to switch on/off a 120V electronic device. Safety warning: I'm an artist and professor, not an electrical engineer. Use caution when dealing with any high-voltage electronic device. My previous tutorial on simple motion detection w a webcam is here: th-cam.com/vide...
TD as Game Engine, Part 7: Time
มุมมอง 449ปีที่แล้ว
A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 7 shows how to solve problems with absTime.seconds that arise in a long-term installation. 00:00 Problems in long-term installation 01:40 Solution w Clock CHOP and Speed CHOP 02:45 Why does this...
TD as Game Engine, Part 6: Render Pass
มุมมอง 817ปีที่แล้ว
A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 6 shows how to use the Render Pass TOP to have greater control over TOP-based fx chains while still maintaining depth information for masking. 00:00 Intro 01:35 When to use Render Pass 02:45 Ren...
TD as Game Engine, Part 5: Audio
มุมมอง 409ปีที่แล้ว
A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 5 explores the audio system, focusing on zone-based triggering, fading, optimization, and mixing. 00:00 Zone-based audio triggers 04:00 Play toggle and fade in/out 06:55 Simple version sans fadi...
TD as Game Engine, Part 4: Zones
มุมมอง 508ปีที่แล้ว
A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 4 shows how to create different "zones" in the virtual environment, track the camera's movement through them, and trigger events based on that zone tracking. 00:00 How it's done in Unreal/Unity ...
TD as Game Engine, Part 3: First Person Camera
มุมมอง 882ปีที่แล้ว
A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 3 investigates the "FPC_LOCATION_CONTROL" container, which handles how our joystick input gets translated into camera movement in the world coordinate system. 00:00 Intro 00:29 Map Joystick to W...
TD as Game Engine, Part 2: Input
มุมมอง 813ปีที่แล้ว
A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 2 covers the use of a Joystick CHOP and Keyboard In CHOP to create a flexible control input system. 00:00 Data from XBox controller 03:18 Switch Keyboard/Joystick input 03:40 Parsing Keyboard In...
TD as Game Engine, Part 1: Structure
มุมมอง 2.4Kปีที่แล้ว
A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 1 gives an overview of the project and its organizational structure, and the various topics that I hope to cover in the series, including: - First Person Camera (FPC) input and location control ...
Group N Primitives w Add SOP
มุมมอง 235ปีที่แล้ว
This video shows a bit more of the creative problem-solving process than most other tutorial videos. It is based in a specific problem a student was having, and shows one solution using the "Group N Primitives" parameter of the Add SOP (which is a technique that frankly I've never had to use before). 00:00 What's the problem 01:41 Thinking 02:55 Add SOP 06:44 Primitive SOP 08:35 Shaping our CHO...
Real-time ASCII Art Effect
มุมมอง 3Kปีที่แล้ว
Demo on how to create a real-time ASCII Art effect in TouchDesigner from webcam input. Complete control over mapping arbitrary characters to quantized pixel values using Instance Texturing. 00:00 ASCII Art & Vuk Cosic 00:50 Overview 02:00 Instancing Texture Coordinates via CHOP 02:55 Texture3D TOP 06:30 Fill Texture3D TOP w Table DAT and Select DAT 10:00 Fine-tuning "w" Texture Coordinate with ...
Simple Time Delay w Cache TOP
มุมมอง 1.7Kปีที่แล้ว
A quick demonstration of using a Cache TOP and some Cache Select TOPs to do a simple time delay effect à la Dan Graham and other video artists of the 1970's.
Moving Bodies Part 1: Simple Detection w Webcam
มุมมอง 709ปีที่แล้ว
The MOVING BODIES series of tutorials will focus on methods for detecting and tracking movement in an installation environment. Planned topics include: Part 1: Simple Detection with Webcam Part 2: Simple Detection with Sensors Part 3: TDRunway Pose Part 4: Mediapipe Pose Part 5: Oak-D Pose Part 6: Kinect Pose Part 7: ZigCam Body Tracking Plenty more tools we could dive into, let me know in the ...
Oak-D + TouchDesigner Part 4: Run Other Object Detection Models
มุมมอง 1.4K2 ปีที่แล้ว
A continuation of Part 3 running object detection on the Oak-D camera. This time we're browsing the Roboflow universe and using a public model there to detect playing cards, then creating some audiovisual events in TouchDesigner that respond to specific combinations of cards 3 of a Kind, Straight, and Royal Flush. The document used in the video with steps written out can be found here: drive.go...
Oak-D + TouchDesigner Part 3: Object Detection
มุมมอง 3.7K2 ปีที่แล้ว
Oak-D TouchDesigner Part 3: Object Detection
Oak-D + TouchDesigner Part 2: Sending Depth and RGB Frames via NDI
มุมมอง 4.4K2 ปีที่แล้ว
Oak-D TouchDesigner Part 2: Sending Depth and RGB Frames via NDI
Oak-D + TouchDesigner Part 1: Getting Started
มุมมอง 6K2 ปีที่แล้ว
Oak-D TouchDesigner Part 1: Getting Started
OSC Apps Part 4: Zig Sim Pro "Face Hero" game
มุมมอง 1K2 ปีที่แล้ว
OSC Apps Part 4: Zig Sim Pro "Face Hero" game
Projection Mapping w Kantan Mapper Part 3
มุมมอง 1.1K2 ปีที่แล้ว
Projection Mapping w Kantan Mapper Part 3
Projection Mapping w Kantan Mapper Part 1
มุมมอง 7K2 ปีที่แล้ว
Projection Mapping w Kantan Mapper Part 1
Projection Mapping w Kantan Mapper Part 2
มุมมอง 1.7K2 ปีที่แล้ว
Projection Mapping w Kantan Mapper Part 2
Nice Work!
Hello, I am trying to follow this tutorial to create a skybox. Could you explain more about how to make the HDRI image loop? Is the parameter set in LFO?
Yeah the background image is scrolling because the LFO is sending a CHOP reference to the Transform TOP tx parameter. In the "Extend" property of the Transform TOP you can set it to "Mirror", which will make it tile seamlessly
My buttons are not clickable?
Simple and concise, great information. Thanks for the tutorial :~)
Thanks!
Great video! Are you able to produce a sound from your VST sampler without using MIDI? I'm interested in your project! Thank you!
Thank you Blake!
new VCV user here SEQ 3 is not totally friendly to new users in my opinion right click on the SEQ 3, tick the Clock passthrough the trig and clock outputs are now 50% duty cycle, and very useable hope this is correct and helpful i am really enjoying your VCV tutorials
Nice trick, thanks for sharing
hi! how exactly do i connect the chop to the app? it won't see it
Phone and computer must be on same WiFi network… sometimes network might have security that prevents OSC communication so you can try creating a hotspot from one of the devices instead
Very good tutorial. The bad thing about OSC-Out is that it only reacts to the information that is located in the center-left of the Touchdesigner screen. Everything that happens outside of that frame does not send any type of information to the OSC-Out and therefore not to VCV Rack. I've been trying to find a solution all weekend but I haven't been able to because I have a low level of TD, although I'm not a beginner. I have also not been able to get the OSC-Out to accept values that go from negative to positive in Touchdesigner. Either they stay negative or they stay positive, but not both. All this greatly limits the possibilities of what could be done with both programs. Do you think there would be any solution?
Hi Raul, thanks. Hmm not sure what your problem w OscOut CHOP might be, you should be able to merge all the channels you want and as long as they have unique names they should all be sent. Re range of values, in the Trowasoft module in Rack you can “convert values”, so manually set range of CHOP then range of CV you want to be converted to
@@BlakeMarquesCarrington 748 / 5.000 Hello again, I have continued investigating and I think I now know where the problem is and it is in ToptoChop. I'll try to explain myself better. Let's put in Touchdesigner a completely static horizontal white line that divides the screen into two equal parts. Now let's put three lines, one red, one green and one blue that move up and down (with a Noise or an Lfo). Well, it turns out that Toptochop only sends information when the colored lines touch the white line, that is, when they pass through the center. Therefore VCV RacK will only be able to receive information if there is some element in the center of the image made in Touchdesigner. I'm sure there must be some solution but I'm unable to find it, that's why I ask for your help :)
Can I use Zig Sim with Windows? That is, send the signal from the iPhone to a laptop.
Yes, just need to input the laptop’s IP Address in app settings
Even so much later: thank you so much
But what to do, if my VCO has no FM input so far?
Hi, not all VCO’s have FM input so you’ll have to browse through the ones available in the menu
what is that noise!!!
Omg there was some intense construction going on right under me 😅
great tutorial, thanks! also you look exaclty like german football manager jurgen klopp
Hahaaa thanks
thanks so much ! exactly what i was looking for
Create vj setting in touch is so complex , you're me a incredible risorse, thanks so much for your job
these videos are so valuable and underrated. You take the time to explain what other TD educators gloss over in recipe tutorials. Thank you a thousand times!
Thank you for the appreciation!
Hi, For a project I am working with ZIG SIM PRO’s ARKIT. I am tracking 5 points (head, right hand, left hand, right leg and left leg) to create a polygon in TouchDesigner which follows the shape of a person. The app keeps closing itself after a few seconds. I don’t know why…, maybe because the iPhone sends the data from EVERY point on the persons body, which is a lot. I'm using an iPhone 14 pro, so this should not be the problem. That’s why I was wondering if it is possible to select only the bodyparts that I’m using in my project in ZIG SIM? That way I can make the data transmition a little easier. Or if anyone has another suggestion, feel free to share it with me! Maybe this won’t be a problem with a newer iPhone. In tutorials everything seems to be working fine. Thank you in advance!
thanks!
This was soooo helpful, exactly what I was looking for, thank you!
What I am trying to do is to take this song (th-cam.com/video/DJTKWAmqBRU/w-d-xo.html) and isolate the flute and piano channels so I can use them to drive some visuals. Thanks in advance for any insights and guidance.
Thank you for this tutorial. I am trying to learn the fundamentals of audio material so I can apply the required transformation in my projects. Do you recommend always resampling (from 44100 to 60) as best practice when using audio signals as data ?
Hi, my zig sim pro crashes all time only when I use body detection by ARKit. How can I solve? (I'm using an iPhone 14 Pro and an iPad Pro 2020)
Yeah i have the same problem, also the values don't tranfer to touchdesigner
have you been ablo to solve this problem??
Hi all, it crashes for me as well in Body mode. I recommend using the ZIGCAM app made by same developers, also one called iKeleton OSC is nice and simple for getting body pose estimation.
Thanks Always! Quick question! Can we get some data from smartwatch to touchdesigner?
Sorry haven’t tried!
awesome material, thank you so much
love it!👍
Thanks!
After that I place my shape, I can't edit them.. can't change the color or the name, and can't add texture to it as well
It was my version of touch designer 2023 experimental who was bug, I use a 2022 version and it's good :)
thank you! Nice tutorial!
Duplicate Shapes Select a shape and hold the Alt key when transforming the shape to create a copy.
Can you write down the required components,sensors for me please? I have the starter kit but I don't know where to look for the big rectangle sensor thing
Exactly the explanation I was looking for! Thanks a lot
Didn't miss a sec! Thank you a lot!
hi, thanks for this! I'm curious could the accelerometer data + speed chop be used to translate an object in sync with the phone's motion? I'm trying to see if I can get a basic virtual camera setup using zig sim, and rotating the TD camera with quarternions works fine, but translation seems to keep resetting, or only work on 2 out of 3 axes. Maybe I'm misunderstanding what it does?
Great question, I have a separate video about that using an XBox controller to move through a virtual world. See th-cam.com/video/Sj0M57IiYCA/w-d-xo.htmlsi=i5EUbm_vVf77_9wp
Quick answer is yes Speed CHOP for txyz is the core operator but to get proper orientation u need a trigonometric function
awesome thanks! I'll take a look at that and the other vid @@BlakeMarquesCarrington
I've just finished up all three parts of the kantan mapping tutorial. I've used youtube tutorials to learn many different softwares over the years, and I felt compelled to comment on how great this tutorial is. In particular, you found ways to teach the core concepts clearly and you did such a great job of separating how's and whys. I loved when you showed how to remask the circle in multiple ways, and your way of speaking resonates with me. I also think you do a great job of re-iterating core concepts after you've gone into more details on the specific example. Looking forward to learning TouchDesigner with you!!
Thanks so much for your comment! 🙏🏻
Really usefull and detailed, thank you :)
Thank you this is exactly the tutorial i needed!
Thank you for the awesome Tutorial! I wonder How can separate the first Column of row in convert 1
Thank you! You can use another Select DAT after that to select by row and column index... so if you only wanted Row 0 Column 0 you could specify that in the row and column start and end index parameters
gymnastics! loved that!!
hi... for multitouch we have multiple values. which expression should we use to take all values as reference for one particular parameter. lets say for transform x how we use multiple values as chop reference ? which expression we use ?
if we have multiple values for transform x and y lets say we have two values for each x and y which expression we use for transform top for these multiple values.
Maybe average the multiple values w a Math CHOP?
Hi thanks for sharing this gem :))
It's strange that my code runs on Arduino, but I can't connect it to TouchDesigner. The error message reads: 'Warning: Could not connect to the device /dev/cu.usbmodem1301 (/project1/serial1)'
I would guess that the Serial Monitor in Arduino IDE and Serial DAT are active at same time? Only one connection at a time is possible
Can ZIG SIM customize the UI panel?
No the zig sim app does not give UI appearance controls, it’s meant to just send data
TAPTEMPO.tox is available at the link in description!
thx for this <33
Thanks for your vid bro. Btw at 8:58 you could manually enter f#4 at VCO freq knob and it works too.
I've just started getting into Touchdesigner and I've always wanted to do something similar to this. I didn't even think it was possible to do the things I wanted to do with this program but boy was I proven wrong. I've certainly got a long way to go with my use of Touchdesigner, but this is certainly inspiring. Great video!
Hi! It's amazing! I also want to use arduino to control vcv rack then connect vcv rack to touchdesigner. But I counld't make arduino connect to vcv rack (I tried to download some modules but it didn't show up in modules section). I'm wondering are you connecting arduino to touchdesigner, then touchdesigner connects to vcv rack?
Thanks! Yes, you can find a tutorial in my channel on sending sensor data from Arduino to TD, then from TD you can parse it however needed then send to Rack via OscOut Chop
@@BlakeMarquesCarrington Cool! I'll check it out. Have you ever tried to connect arduino to vcv rack first? Is it possible? I've looked for the tutorial but non of them works for me. I'm wondering do you have the experience of connecting arduino to vcv rack?
@@sabrinawst Good question, I've seen some examples of that on Github but have never done it myself, seems like the data from Arduino needs to be converted to MIDI CC messages somehow~
Dope videos and dope channel. Thanks for sharing with audience
thank you for this explanation, i'm just getting into building controls in td and it's been so helpful following along
TOO COOL!!!! Wow thanks for showing the Arduino code, and also including the 3 types of input, instead of just one. And the count tip - all very useful & simple - excellent explanation - thanks!