- 48
- 362 716
Torin Blankensmith
เข้าร่วมเมื่อ 11 ต.ค. 2011
Torin is a freelance creative technologist, educator, and real-time graphics artist focusing on mixed reality installations and interactive experiences.
He teaches interactive and immersive environments with TouchDesigner, as well as creative coding at Parsons The New School in NY.
Currently, Torin works at Studio Elsewhere creating restorative immersive environments in collaboration with neuroscientists focused on patient and medical workers’ well-being.
He teaches interactive and immersive environments with TouchDesigner, as well as creative coding at Parsons The New School in NY.
Currently, Torin works at Studio Elsewhere creating restorative immersive environments in collaboration with neuroscientists focused on patient and medical workers’ well-being.
Text-to-Speech ElevenLabs Plugin for TouchDesigner + Whisper, ChatGPT, and MediaPipe Integration
In this tutorial, you'll learn how to use the new ElevenLabs text-to-speech plugin for TouchDesigner. We'll also walk through a project creating a voice-activated 3D talking character by integrating Whisper for speech-to-text, ChatGPT for generating dialogue, ElevenLabs for text-to-speech, and MediaPipe for motion tracking to create an interactive experience.
Link to project file + Plugin on Patreon: www.patreon.com/tblankensmith
Previous Tutorial on ChatGPT and Whisper: th-cam.com/video/34s2p9gzWhs/w-d-xo.html
Noto the Talking Ball's Tutorial: th-cam.com/video/va6cxORsFMw/w-d-xo.html
MediaPipe Plugin Tutorial: th-cam.com/video/Cx4Ellaj6kk/w-d-xo.html
0:00 Overview
3:11 ElevenLabs Plugin Overview
7:22 Connect ChatGPT to ElevenLabs
10:11 Configure Whisper with ElevenLabs
17:40 Add MediaPipe Face Tracking
Link to project file + Plugin on Patreon: www.patreon.com/tblankensmith
Previous Tutorial on ChatGPT and Whisper: th-cam.com/video/34s2p9gzWhs/w-d-xo.html
Noto the Talking Ball's Tutorial: th-cam.com/video/va6cxORsFMw/w-d-xo.html
MediaPipe Plugin Tutorial: th-cam.com/video/Cx4Ellaj6kk/w-d-xo.html
0:00 Overview
3:11 ElevenLabs Plugin Overview
7:22 Connect ChatGPT to ElevenLabs
10:11 Configure Whisper with ElevenLabs
17:40 Add MediaPipe Face Tracking
มุมมอง: 1 138
วีดีโอ
Hand Tracking in TouchDesigner with MediaPipe - TouchDesigner Beginner Tutorial
มุมมอง 4.2K4 หลายเดือนก่อน
This tutorial is inspired from the Genuary (generative art month in January) prompt from day 3 to create something in the style of a Droste effect / a Picture in a Picture. I use the MediaPipe hand tracking plugin created by Dom Scott and myself to controll the motion. This also features a bonus Reaction Diffusion effect. Link to Genuary: genuary.art/ Link to the MediaPipe plugin: github.com/to...
Face, Hand, Pose Tracking & More in TouchDesigner with @MediaPipe GPU Plugin
มุมมอง 31K8 หลายเดือนก่อน
Hey! In this tutorial, we'll go over the new free open-sourced MediaPipe plugin for TouchDesigner that's GPU accelerated and works on Mac and PC with no instillation. The plugin supports face, hand, pose and object tracking with multi-person face detection, object detection, and image segmentation / background removal. Link to the GitHub to download the Plugin: github.com/torinmb/mediapipe-touc...
Tutorial 2/3 - Audio Reactive & Motion Controlled Visuals in TouchDesigner
มุมมอง 9K10 หลายเดือนก่อน
Tutorial 2/3 - Audio Reactive & Motion Controlled Visuals in TouchDesigner
Tutorial 1/3 - New Body Tracking Plugin for TouchDesigner - No Kinect Needed
มุมมอง 17K10 หลายเดือนก่อน
Tutorial 1/3 - New Body Tracking Plugin for TouchDesigner - No Kinect Needed
GPT-4, ChatGPT, and Whisper(speech-to-text) Plugins for TouchDesigner
มุมมอง 12Kปีที่แล้ว
GPT-4, ChatGPT, and Whisper(speech-to-text) Plugins for TouchDesigner
Video to Video AI Style Transfer with Stable Diffusion and Keyframing in TouchDesigner - Tutorial
มุมมอง 10Kปีที่แล้ว
Video to Video AI Style Transfer with Stable Diffusion and Keyframing in TouchDesigner - Tutorial
Create Audio Reactive Shaders With Three.js and Shader Park
มุมมอง 11Kปีที่แล้ว
Create Audio Reactive Shaders With Three.js and Shader Park
Audio Reactive Animations with Stable Diffusion and TouchDesigner - Tutorial 3
มุมมอง 34Kปีที่แล้ว
Audio Reactive Animations with Stable Diffusion and TouchDesigner - Tutorial 3
Web GUI for TouchDesigner - Component & Beginner Tutorial
มุมมอง 8Kปีที่แล้ว
Web GUI for TouchDesigner - Component & Beginner Tutorial
Generate AI Images with Stable Diffusion + Audio Reactive Particle Effects - TouchDesigner Tutorial
มุมมอง 19Kปีที่แล้ว
Generate AI Images with Stable Diffusion Audio Reactive Particle Effects - TouchDesigner Tutorial
TouchDesigner Tutorial - Generate AI Images with Stable Diffusion using Image-to-Image Generation
มุมมอง 43Kปีที่แล้ว
TouchDesigner Tutorial - Generate AI Images with Stable Diffusion using Image-to-Image Generation
Tutorial 2 - Shader Park Beginner Course : Space Modifiers, Noise & Reusable Custom Geometries
มุมมอง 3.2Kปีที่แล้ว
Tutorial 2 - Shader Park Beginner Course : Space Modifiers, Noise & Reusable Custom Geometries
Body Tracking with No Kinect in TouchDesigner 2022
มุมมอง 16Kปีที่แล้ว
Body Tracking with No Kinect in TouchDesigner 2022
Tutorial 5.1 BONUS - Use the Table DAT with Python. Control TD with a Website using WebSockets
มุมมอง 1.7Kปีที่แล้ว
Tutorial 5.1 BONUS - Use the Table DAT with Python. Control TD with a Website using WebSockets
Tutorial 6 - Send & Receive Messages from a Website. Control TD with a Website using WebSockets
มุมมอง 2.6Kปีที่แล้ว
Tutorial 6 - Send & Receive Messages from a Website. Control TD with a Website using WebSockets
Tutorial 5 - Receiving a WebSocket Message in TD. Control TD with a Website using WebSockets
มุมมอง 2.3Kปีที่แล้ว
Tutorial 5 - Receiving a WebSocket Message in TD. Control TD with a Website using WebSockets
Tutorial 4 - Send Data from TD to a Website. Control TouchDesigner with a Website using WebSockets
มุมมอง 3.7Kปีที่แล้ว
Tutorial 4 - Send Data from TD to a Website. Control TouchDesigner with a Website using WebSockets
Tutorial 3 - Testing with WebSocket King. Control TouchDesigner with a Website using WebSockets
มุมมอง 3.7Kปีที่แล้ว
Tutorial 3 - Testing with WebSocket King. Control TouchDesigner with a Website using WebSockets
Tutorial 2 - Host a Free WebSocket Server on Heroku. Control TD with a Website using WebSockets
มุมมอง 5Kปีที่แล้ว
Tutorial 2 - Host a Free WebSocket Server on Heroku. Control TD with a Website using WebSockets
Tutorial 1 - Intro & Overview of WebSockets. Control TouchDesigner with a Website using WebSockets
มุมมอง 7Kปีที่แล้ว
Tutorial 1 - Intro & Overview of WebSockets. Control TouchDesigner with a Website using WebSockets
Shader Park Plugin for TouchDesigner & A Rendering Workflow
มุมมอง 6K2 ปีที่แล้ว
Shader Park Plugin for TouchDesigner & A Rendering Workflow
Tutorial 1 - Shader Park Beginner Course : Core Primitives & Coloring
มุมมอง 4.1K2 ปีที่แล้ว
Tutorial 1 - Shader Park Beginner Course : Core Primitives & Coloring
Background Removal and Custom Webcam Effects: TouchDesigner Tutorial. Mac + PC
มุมมอง 7K2 ปีที่แล้ว
Background Removal and Custom Webcam Effects: TouchDesigner Tutorial. Mac PC
Audio-Reactive Visuals in TouchDesigner
มุมมอง 62K2 ปีที่แล้ว
Audio-Reactive Visuals in TouchDesigner
Link up Web Midi Instruments to your DAW of Choice
มุมมอง 5275 ปีที่แล้ว
Link up Web Midi Instruments to your DAW of Choice
thank youuuuu
太谢谢惹!!!!!好棒好棒的组件! 😁
thank you sososososooooo much. you are a literal angel and saved my life and i swear i'll join your patreon when i'm not a broke college student 💗💗💗💗
This is truely amazing, thanks for all the hardwork
Thanku so much for this amazing video and also for the link of file. My API component is not working can u plzz tell me is it due to version difference of touch designer if it is so plzz tell me which version u used for this.
It works fine for me on the latest TD version. Just make sure you create an API key on computerender.com/ and swap out your key in the project
Thanks for the plugin! For anyone having issues with the MediaPipe tox loading forever, the last version of 2022 (.35320) works for me on an M1 mac. I just avoided having to upgrade my commercial license for another $300 over this.
Hi Torin! Thanks for your plugin. But do you know why the error keep running "You exceeded your current quota". I upgraded the plan and using ChatGPT 4.
extremely underrated channel. Thank you!!!
i would be really grateful to understand the spoutcam for windows in depth for the mediapipeline plugin. Thank you
Hi, I'm trying to change some parameters in your text-to-speech plugin to suit my project, but it won't work after I unlock script2, I wonder what's the point of locking script2?
Locking the script2 CHOP allows you to programmatically write data into the ScriptCHOP. The audio data gets streamed in as chunks of data and I wanted to have the lowest latency so that you can start playing the audio the second it starts streaming instead of waiting until the whole thing finishes downloading.
@@blankensmithing Oooh, thank you very much for your answer, I kind of understand that you wrote a script that reads elevenlabs and streams back the audio and put it in scriptchop, and when scriptchop locks, the script freezes in TD,Like bg1TOP locked?
We appreciate you!
Hi Torin, Ive been using the MediaPipe plugin for my research project for over a month now. Ive had some questions and there aren't enough tutorials online for mw to figure out how to go about this. My project is exploring narrative animation driven by gestures. The animations are made on blender and I use the media pipe plugin to play these animations, so for example if you wave at the screen (open palm) the character in the animation waves back at you. Anyway I dont want to go into much detail but if this something that interests you I would love if I got some help, although this plugin id already helping me realise my enquiry. thanks so much, Anna
thank you very much for sharing this project, I tried to generate images and everything worked correctly until yesterday. Despite I added credits on computerender, since today, when I generate an image I get an error back “ {”status“: ‘error’, ‘message’: ‘Could not find \’complete\” state within timeout. You may try again.", ‘errorType’: ‘INTERNAL_ERROR’, ‘jobId’: ‘60f87997ecc64cba35e185a74ed0a4498c1b89e5’} ‘ ’, could you tell me how to fix it? thank you very much, i love your channel!
I've the very same problem. It worked correctly until few hours ago...
This is insane
This is amazing!!
omg this so so good LOL! Great use case... I assume the sour cream is under the hat?
yea ! you made it :) great work
so cool, thank you!
More than amazing ! Thank you so much
Is it possible to use this while also seeing the video feed from the background TOP of the container? I've built an app for an upcoming show and I was really hoping I would be able to just access and interact with the component from my iPad but it appears to be not as straight forward as I had originally thought.
Yeah, at the end of the video th-cam.com/video/H8ePMpF3s_c/w-d-xo.htmlsi=7fW34_3FB1JGW_CQ&t=1636 I show how to use VDO Ninja to share a live feed of TD to the browser
@@blankensmithing Thank you! Will I be able to click buttons as well? Or will this just display the video feed? I was hoping to retain the ability to interact with buttons as I've built out a simple app that can navigate between different pages.
@@bentheremedia3011 yeah both work :)
@@blankensmithing I've not been able to figure out how to click buttons through the live feed. It's my understanding that VDO Ninja is broadcasting a video feed but this does not give me interactivity with Touch Designer similar to how remote desktop would function. Are you aware of any ways to have an iPad acting as an interactive monitor for TD in Perform mode? That's basically what I'm after. I have a photobooth application that has buttons that need to be pushed in order to navigate between the different pages and I was hoping to be able to run it off of an iPad but I haven't been able to find a straightforward way of doing that.
Hey guys! Anyone knows if there is a workaround to use Mediapipe TD for vertical video / stream?
genio <3
Can you connect cameras like arri?
I just heard someone mentioning about "touchDesign Audio Reactive" and I searched it on TH-cam out of curiosity. I am so glad I did. I found you and gonna try this tutorial. so amazing!! subscribed!!
I really appreciate this tutorial. Not only the subject matter but the way you actually explain each part. Many of the Touchdesigner tutorials come off mathematical with no simple explanation of why a certain OP is used. Thank you
I'll echo what everyone else is saying - this is incredibly helpful! Exactly what I was looking for in terms of a tutorial. Thank you so much!
Just downloaded MediaPipe and I'm super excited to use it but the loading seems to never end for me I also submitted the issue on Github with more details Hope I get to make it work soon Appreciate your fantastic work and your help in advance
This is so awesome! I'm %100 gonna be hitting up your patreon for the project files, this is exactly the kind of stuff I've been trying to learn more about. I would love to implement this into a project. How many people is this able to track at once?
Dope
is it possible to do it locally?
very good thank you!
I have a lot of love and respect for the work you are doing. Thank you for sharing ❤
You can’t make a tutorial on taste 🤌
Amazing stuff. Not sure I will ever needed but very nice. Bravo!
So amazing!
Soooo cool!
So amazing! Fascinated by your work. Very inspiring :)
Hi Torin, I'm slowly getting to understand more about the plugin. I tried following this tutorial with the Media Pipe plugin, everything worked really great, just needed to adjust the lagging for easing but what I can't seem to find on that one is the lagging features in the recent version of the plugin. Does it contain the lagging features? if so do they have another name or where can I find it?
hey, yeah you can use a Lag CHOP to smooth out the motion. Alternatively, you can use a Filter CHOP, but turn down the filter width
thank you!@@blankensmithing
thank you for your work it's real fun to use this and a lot of possibilities. I have one question: would it be possible to use the mediapipe plugin in td with an Infrared webcam?
I am doing a face-tracking vfx project right now, your Mediapipe is an actual life saver, but there is an issue that the Mediapipe container node keeps showing the loading animation, how could I fix this? Thanks in advance!!!!
awesome stuff!
algorithm food
Awesome!!
Hey,Torin.This video is very very good, but after I modified the keywords in TD, it kept showing loading and nothing happened. My version number is 2022.32660. What should I do?
Huh!?
Video changed my life lad fuck yeah
Underrated video
DUDE! Ha! That’s so cool. Super clever. A+
Ahaha Rival Consoles is such a gem for audioreactive effect
Should we implement the websocket DAT on a new project or should we implement it on an existing project?
you can do it in either