reflekkt
reflekkt
  • 24
  • 106 716
3D Projection Mapping Tutorial with Photogrammetry and TouchDesigner
Learn how to master 3D projection mapping! This complete workflow covers everything you need, from photogrammetry to build a virtual model of your real-world object, to using TouchDesigner and CamSchnappr with the sweetspot method for perfect 3D mapping, fine adjusting with the Stoner Tool and creating content that seamlessly fits on your surface.
Find the project file for this and more projection mapping workflows on my Patreon: www.patreon.com/reflekkt
Instagram: reflekkt_
Projector suggestions (low - medium budget):
NEC NP-M300W (WXGA 3000lumen): amzn.to/4fpvrOK
NEC NP-M322W (WXGA 3200lumen): amzn.to/40PGdtl
BenQ MW560 (WXGA 4000lumen): amzn.to/3Z8JFha
Optoma HD30LV (Full HD 4500lumen): amzn.to/3Oc7v5t
Optoma UHD38x (4K 4000lumen): amzn.to/3YKsQYE
*As an Amazon Associate, I earn from qualifying purchases.
In general, I suggest projectors with minimum 3000+ lumens to begin. Outdoor projections need more brightness of course.
TDScripts by Factory Settings to move camera from TouchDesigner to Blender: th-cam.com/video/olRMbGqgxp0/w-d-xo.html&ab_channel=FactorySettings
Time stamps:
0:00 Overview
2:15 Requirements
3:58 Photogrammetry with RealityCapture
12:02 Clean Mesh in Blender
18:15 3D Mapping with TouchDesigner
29:35 Projector Setup
32:45 CamSchnappr Calibration
42:22 Fine Adjustments with Stoner Tool
44:41 Content Creation
57:36 Outro
มุมมอง: 1 016

วีดีโอ

Projection Mapping with KantanMapper - TouchDesigner Tutorial
มุมมอง 2Kหลายเดือนก่อน
KantanMapper is a tool from the TouchDesigner Palette to create masks for projection mapping. In this video, I use it to project some content on a sculpture that I put together from different shapes - cubes, cirlcles hands and a head. It's pretty straightforward as you basically just create a 2D mask for the area you want to project on - with the right content you can still archieve 3D effects ...
AI Generated Projection Mapping Show
มุมมอง 8223 หลายเดือนก่อน
Clip of a projection mapping on a ~10x30m large building. The mapping content is made with comfyUI, the final mapping done in TouchDesigner. Learn how to create AI Projection Mappings: th-cam.com/video/Usv1ND53H2E/w-d-xo.html Project files and more: www.patreon.com/reflekkt Instagram: reflekkt_
Advanced AI Projection Mapping Workflow
มุมมอง 3.4K3 หลายเดือนก่อน
Generate projection mapping content for any object. Using comfyUI with some mask segmentation and controlnets, you can auto-generate unlimited content. You just need a mask of your projection surface and some style references. Project Files: www.patreon.com/posts/advanced-ai-109356342 My IG: reflekkt_ Overview of the Workflow: 1. Capture a photo from the projector's perspective. ...
Content Creation for Immersive Spaces - comfyUI & Colab Tutorial 2/2
มุมมอง 8824 หลายเดือนก่อน
The second part of this series is all about advanced AI content creation using comfyUI on Google Colab. The Colab Notebook is set up with everything you need for this workflow. Note that you need ~12GB space on your Google Drive. For the workflow file, extra masks and style references check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ Colab Notebook link: drive.goo...
Immersive Space Previsualization - TouchDesigner Tutorial 1/2
มุมมอง 1.8K4 หลายเดือนก่อน
In part 1 of this tutorial series, we build a previsualization setup for an immersive space and learn what format your content needs to have, to be displayed correctly. You get to know what a pixelmap is and be prepared to set this up for your own venues or possible gigs. Part 2 will cover a more advanced content creation technique using comfyUI, an user interface for StableDiffusion. For the p...
Synthetic Sculptors - Interactive Media Installation (TouchDesigner & AI)
มุมมอง 6895 หลายเดือนก่อน
Throughout history, the essence of human beings and the way of its creation has always involved two humans. Yet, artists possess a unique ability to transcend this necessity, forging only one bond between creator and creation. In our exploration, we want to question the creation process, this time engaging the intersection of human and artificial intelligence through the medium of sculpture. He...
Interactive Eye Projection with Webcam or Kinect - TouchDesigner Tutorial 009
มุมมอง 15K7 หลายเดือนก่อน
In this TouchDesigner tutorial, you learn how to create an interactive projection, where an eye follows people passing by. I use a webcam and the bodytrackCHOP to track persons, but you can also use a Kinect or other data like mouse cursor position, noise or any other object. With free AI image generation tools like Bing Image Creator, you can create your own texture, I used PromeAI: www.promea...
Audio Reactive Instancing - TouchDesigner Tutorial 008
มุมมอง 10K10 หลายเดือนก่อน
Learn the technique of instancing combined with audio reactivity. This tutorial guides you step by step and explains easily how to manipulate the instance data with CHOPs for high performance and fps. Color Lovers Picker: derivative.ca/community-post/asset/colour-lover-palette-picker/62697 For more content check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ 0:00 Int...
AI Projection Mapping Tutorial
มุมมอง 23K11 หลายเดือนก่อน
Learn an easy way of creating content for projection mapping with AI and how to map it on an object with TouchDesigner. This method is beginner friendly, quick and gets you impressive results. Have fun experimenting! PromeAI: www.promeai.pro/?vsource=i_8fr8d0f2m7 For more content check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ 0:00 Intro & overview 0:45 Projecto...
Vibrant Color Tunnel - TouchDesigner Tutorial 007
มุมมอง 2.2K11 หลายเดือนก่อน
Beginner friedly tutorial to create a vibrant color tunnel in TouchDesigner. Simply said we instance a noise pattern and give it an interesting appearance by using several patterns for position, rotation and scale of the instances. Add some ambient occlusion and we get this beautiful color tunnel. For more content check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ ...
Northern Lights - TouchDesigner Tutorial 006
มุมมอง 8Kปีที่แล้ว
In this quick and easy beginner tutorial, we recreate the Northern Lights in TouchDesigner in under 5min. For more content check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ 0:00 Intro & Overview 0:20 Base Lines 1:17 Post Effects 4:18 Outro #touchdesigner #northernlights #creativecoding
AI Projection Mapping Show
มุมมอง 1.2Kปีที่แล้ว
A short clip of a projection mapping I showcased at University of Applied Sciences Offenburg during the annual "Werkschau". The contents are mostly generated with help of different AI tools, the mapping is done in TouchDesigner. Thanks to my university@HochschuleOffenburgHSO for providing the technical equipment, projection surface and opportunity to show my semester work :-) For more content c...
Star Galaxy Vortex - TouchDesigner Tutorial 005
มุมมอง 11Kปีที่แล้ว
Star Galaxy Vortex - TouchDesigner Tutorial 005
Audioreactive Kinect Dancer - TouchDesigner Tutorial 004
มุมมอง 12Kปีที่แล้ว
Audioreactive Kinect Dancer - TouchDesigner Tutorial 004
Interactive Nvidia Flex Fluids Inside 3D Objects - TouchDesigner Tutorial 003
มุมมอง 2.4Kปีที่แล้ว
Interactive Nvidia Flex Fluids Inside 3D Objects - TouchDesigner Tutorial 003
Trippy Visuals - TouchDesigner Tutorial 002
มุมมอง 6Kปีที่แล้ว
Trippy Visuals - TouchDesigner Tutorial 002
Interactive Fire Particles - TouchDesigner Tutorial 001
มุมมอง 4.5Kปีที่แล้ว
Interactive Fire Particles - TouchDesigner Tutorial 001
Shifting Nature @ Abendlicht
มุมมอง 3953 ปีที่แล้ว
Shifting Nature @ Abendlicht
Shifting Nature - Interactive Art Installation
มุมมอง 5503 ปีที่แล้ว
Shifting Nature - Interactive Art Installation

ความคิดเห็น

  • @menybliss
    @menybliss 3 วันที่ผ่านมา

    Wow amazing result!!! takes for put a lot of affort to share with us the all the process of 3D projection.

  • @DePhileas
    @DePhileas 3 วันที่ผ่านมา

    Slaaaaap

  • @davidalanmedia
    @davidalanmedia 13 วันที่ผ่านมา

    That is so cool!

  • @danielaraileanu5770
    @danielaraileanu5770 24 วันที่ผ่านมา

    Thank you for this detailed explanation! Be blessed!!!

  • @PochoArq
    @PochoArq 28 วันที่ผ่านมา

    I was following your tutorial and I think because I have a MacBook I couldn't advance in the "bodytrack" part. How can I do it? tanks

  • @myasinesin
    @myasinesin 28 วันที่ผ่านมา

    Great tutorial! Thanks. In realtiem viewport i saw seamless loop but when I try to export as video, the loop isn't working. IS there any way to make seamless loop in export?

  • @elydz_
    @elydz_ หลายเดือนก่อน

    amazing thank u

  • @neponel
    @neponel หลายเดือนก่อน

    big thx. keep up the great work. +1 patreon supporter.

  • @jbdemo
    @jbdemo หลายเดือนก่อน

    thanks !!

  • @danisan683
    @danisan683 หลายเดือนก่อน

    Great tutorial, thank you so much. If i can ask. What is the proyector that you are using?

    • @reflekkt_net
      @reflekkt_net 29 วันที่ผ่านมา

      I use a NEC ME372W that I scored on ebay for 300euro around 2 years ago. You can do projection mapping with cheap projectors, no need for a fancy setup if you are just learning. Personall I would just not choose a short throw, as the positioning can get weird and can cause lots of shadows if you have a 3D object.

  • @arshinazizi
    @arshinazizi หลายเดือนก่อน

    Fantastic thank you so much 🎉 appreciate your time ... How you make video for this physical object.do you do 3D scan of your object ? Or do another way? Thanks in advance for your response🙂🙏🏻

    • @reflekkt_net
      @reflekkt_net 29 วันที่ผ่านมา

      It's made with the comfyUI workflow I mention in the beginning and needs only one image as input, no need for a 3D scan.

  • @rameshdevasi6720
    @rameshdevasi6720 หลายเดือนก่อน

    if we make ring of projectors pointed toward a big sculpture, it would be cool.

    • @reflekkt_net
      @reflekkt_net หลายเดือนก่อน

      Multi projector setups are next on my list : )

  • @menybliss
    @menybliss หลายเดือนก่อน

    Great one! will like to see more on the KantanMapper with multi textures, layer duplications and more.....

    • @reflekkt_net
      @reflekkt_net หลายเดือนก่อน

      Thank you! Yes, this video is very basic, I'll cover more about TouchDesigners mapping tools soon!

  • @ramim.5856
    @ramim.5856 หลายเดือนก่อน

    I was really looking for this thanks 😊

  • @TheGladScientist
    @TheGladScientist หลายเดือนก่อน

    Looks great! Ready for the stage 🤘🏼

  • @sudabadri7051
    @sudabadri7051 หลายเดือนก่อน

    Super cool stuff

  • @AtelieristaMHP
    @AtelieristaMHP หลายเดือนก่อน

    could this work with MediaPipe (different body parts tracking) and with multiple people ?

    • @reflekkt_net
      @reflekkt_net หลายเดือนก่อน

      sure, you can just use the position coming from mediapipe instead of a kinect. It is also possible to adjust the project file to work with multiple people, as you can create multiple eye actors with their own bullet solver systems and position inputs. Once you get the idea behind this tutorial, you will be able to extend it :-)

  • @usahome
    @usahome หลายเดือนก่อน

    Wow! Subscribed. 👍

  • @final_animal
    @final_animal 2 หลายเดือนก่อน

    Hi, thanks so much for these tutorials! It's really helpful seeing a practical example of how it all works, thanks a million. I'm trying to estimate costs for an installation of a similar size, do you happen to have info on the type of projectors and media servers used here, and how many of each was needed? I'd also love to hear any info on the projection wall fabric. Much appreciated man, subbed to the TH-cam and Patreon, this is really great content and beautiful work as well.

    • @reflekkt_net
      @reflekkt_net 2 หลายเดือนก่อน

      Thanks a lot, I appreciate it! I have access to the room though my master studies (Digital Art & Creative Technologies at La Salle Barcelona in case someone is interested) and can't tell you much about costs, but they use Watchout as media server system. Write me a message, I can probably get some more infos about hardware as well.

  • @sarah-lo8fj
    @sarah-lo8fj 2 หลายเดือนก่อน

    Nice tutorial! How can I remove the backgroud, so that only the silouette is showing?

    • @asthettic
      @asthettic 3 วันที่ผ่านมา

      you need a kinect, or if on a beefy pc with nvidia you could use the Nvidia background Top

  • @alexandrupop7461
    @alexandrupop7461 2 หลายเดือนก่อน

    When I click start to make the eye follow the geometric position the eye is folloing the eye for a milisec and after that the eye goes far away, why is this happening?

  • @shivamm697
    @shivamm697 2 หลายเดือนก่อน

    so cool can i know the name of the application? and where to download it

  • @nutvers1.0n
    @nutvers1.0n 2 หลายเดือนก่อน

    Where do you place your webcam/kinect to the wall?

    • @reflekkt_net
      @reflekkt_net 2 หลายเดือนก่อน

      I placed mine centered around 4m away from the wall

    • @nutvers1.0n
      @nutvers1.0n 2 หลายเดือนก่อน

      ​@@reflekkt_net thanks

  • @wembley2750
    @wembley2750 2 หลายเดือนก่อน

    Can I add a background video?

  • @showsnsdespa3
    @showsnsdespa3 2 หลายเดือนก่อน

    It's not working the body tracking :c i don't have gpu nvidia... is there any other way?

    • @reflekkt_net
      @reflekkt_net 2 หลายเดือนก่อน

      You could try the MediaPipe plugin, I think it works for Mac too. I never used Mac tho, so not 100% sure.

  • @canadave9
    @canadave9 3 หลายเดือนก่อน

    What a cool tutorial thank you!

  • @ahphiell
    @ahphiell 3 หลายเดือนก่อน

    Wow I've always wondered about this, thank you so much!

  • @vilimomo1696
    @vilimomo1696 3 หลายเดือนก่อน

    Light through the vains jon Hopkins similar project, like a traveling asteroid

  • @vilimomo1696
    @vilimomo1696 3 หลายเดือนก่อน

    Faping prohibited lol

  • @keshav2136
    @keshav2136 3 หลายเดือนก่อน

    Can't believe how useful Kinect was! Great video. Subscribed.

  • @XteVision
    @XteVision 3 หลายเดือนก่อน

    nice mapping instruction. I like it a lot.

  • @aaavisuals2950
    @aaavisuals2950 3 หลายเดือนก่อน

    Dope!!

  • @linggem431
    @linggem431 3 หลายเดือนก่อน

    Thanks a lot. Clear and concise. This tutorial helped me to get the perfect effect and more improtantly, I finally understand the use of point transform. And the use of Bloom is also very inspiring.

  • @joseignacioarias6644
    @joseignacioarias6644 3 หลายเดือนก่อน

    wonderful workflow! Thank you for explaining your ComfyUI network. How can this workflow work for automatic dome mapping, or not so auto dome mapping? *sorry my bad english

  • @dennisliebelt3951
    @dennisliebelt3951 3 หลายเดือนก่อน

    Love it! Now i need a projector so i can try it :/

    • @dennisliebelt3951
      @dennisliebelt3951 3 หลายเดือนก่อน

      Ok you got me fully hyped. I got a little projector and i am testing right now. I wonder about the offset from camera image to projector since in my understanding it has to be aligned properly before generating content. I watched other videos of you and i saw you using for finetune the mask the stoner tool in touchdesigner. I have no clue about touchdesigner so the question is can the mask being exported after the stoner tool or have you found a better/working solution for optimal aligning?

    • @reflekkt_net
      @reflekkt_net 3 หลายเดือนก่อน

      @@dennisliebelt3951 I always use the stoner tool to fine tune the projection in the end and it works pretty well. It's very important that the image you make the mask from is as close to the projector position as possible tho. For complex 3D projection surfaces there is the camSchnappr tool in the TouchDesigner palette, but I was always able to adjust the content with the stoner tool till now. Software like Resolume or MadMapper might have better mapping tools, but I always sticked to TouchDesigner. I want to get deeper into proper 3D mapping soon tho, will probably share my insights when I figured it all out.

    • @dennisliebelt3951
      @dennisliebelt3951 3 หลายเดือนก่อน

      @@reflekkt_net looking forward to your findings!

  • @iamTLC
    @iamTLC 3 หลายเดือนก่อน

    Amazing workflow, thank you for sharing!

  • @sudabadri7051
    @sudabadri7051 3 หลายเดือนก่อน

    Very cool!

  • @sophialiarou4688
    @sophialiarou4688 3 หลายเดือนก่อน

    Very interesting! great ideas!

  • @curiosibotVLC
    @curiosibotVLC 3 หลายเดือนก่อน

    when i add my kinect information it doesn't follow the kinect. tried a few things, but when i add it to switch it displays the torus over and doesn't follow kinect chop

  • @tinglesound6621
    @tinglesound6621 3 หลายเดือนก่อน

    really great tutorial, thank you sooo much

  • @blablabladado
    @blablabladado 4 หลายเดือนก่อน

    How to setup the camera view in the right side_?

  • @MenyAttenti
    @MenyAttenti 4 หลายเดือนก่อน

    Great Content ! thank for sharing your work.

  • @MaxiCrows
    @MaxiCrows 4 หลายเดือนก่อน

    what gpu or cpu we need for make it run?

    • @MaxiCrows
      @MaxiCrows 4 หลายเดือนก่อน

      i get it, i need google colab, can you check the link of the collab ? It dont work

    • @reflekkt_net
      @reflekkt_net 4 หลายเดือนก่อน

      @@MaxiCrows I will upload a mirror in some minutes, the Dropbox link had too many downloads, didn't know there's a limit.

    • @reflekkt_net
      @reflekkt_net 4 หลายเดือนก่อน

      link should work now

  • @evadermusic
    @evadermusic 4 หลายเดือนก่อน

    This is an amazing tutorial man, thankyou so much.

  • @danielliberty7559
    @danielliberty7559 4 หลายเดือนก่อน

    awesome video! how did you group together nodes inside these blue, green and purple rectangles?

    • @reflekkt_net
      @reflekkt_net 4 หลายเดือนก่อน

      Thank you :) you can use shift+b or right click somewhere and choose 'add network box' to create the 'group'.

    • @danielliberty7559
      @danielliberty7559 4 หลายเดือนก่อน

      @@reflekkt_net simply life changing. subscribed.

  • @gusta723
    @gusta723 5 หลายเดือนก่อน

    hola algiuen me puede decir como saco el cuadro de Annotate por favor. soy nuevo en esto muchas gracias de antemano

  • @gusta723
    @gusta723 5 หลายเดือนก่อน

    hola buenas estoy hacinedo tu tutorial por cierto esta buenicimo pero tengo un problema en mi cuadro de CHOP no me sale body track por favor me ayudas muchas gracias

  • @leonidkrykhtin
    @leonidkrykhtin 5 หลายเดือนก่อน

    How to use the interaction with MediaPipe addon? what should be replaced in your network to use the addon?

    • @leonidkrykhtin
      @leonidkrykhtin 5 หลายเดือนก่อน

      Already sorted hahaha

    • @AtelieristaMHP
      @AtelieristaMHP หลายเดือนก่อน

      @@leonidkrykhtin pls help me, how did you do it with MediaPipe? I'm stuck...

    • @mgcsuave6792
      @mgcsuave6792 หลายเดือนก่อน

      @@AtelieristaMHP Instead of using a video device in TOP, insert the MediaPipe plugin by dragging it into the project. Wait for it to load and connect with the camera feed that you want. Then from the three outputs that it has (hand tracking, joint tracking, image tracing) connect the ones you want to apply to the select CHOP, then do a math CHOP to set the range values, and then use the null CHOP to output the data set.

  • @leandercramer681
    @leandercramer681 5 หลายเดือนก่อน

    Looks so cool, would love to try it out!

  • @sulavtechh3028
    @sulavtechh3028 5 หลายเดือนก่อน

    hello sir how to use web camera tracking effects in this tutorial video eye flow