reflekkt
reflekkt
  • 24
  • 116 078
3D Projection Mapping Tutorial with Photogrammetry and TouchDesigner
Learn how to master 3D projection mapping! This complete workflow covers everything you need, from photogrammetry to build a virtual model of your real-world object, to using TouchDesigner and CamSchnappr with the sweetspot method for perfect 3D mapping, fine adjusting with the Stoner Tool and creating content that seamlessly fits on your surface.
Find the project file for this and more projection mapping workflows on my Patreon: www.patreon.com/reflekkt
Instagram: reflekkt_
Projector suggestions (low - medium budget):
NEC NP-M300W (WXGA 3000lumen): amzn.to/4fpvrOK
NEC NP-M322W (WXGA 3200lumen): amzn.to/40PGdtl
BenQ MW560 (WXGA 4000lumen): amzn.to/3Z8JFha
Optoma HD30LV (Full HD 4500lumen): amzn.to/3Oc7v5t
Optoma UHD38x (4K 4000lumen): amzn.to/3YKsQYE
Flexible projector mount components:
Avenger F301 Baby Wall Plate: amzn.to/4g4ztMj
Avenger E250 5/8" Baby Pin: amzn.to/4i8ZhZy
Manfrotto Superclamp: amzn.to/4i2Y71N
Avenger F830 Swivelling Adapter: www.thomann.de/de/avenger_f830_swivelling_adapter.htm
*As an Amazon Associate, I earn from qualifying purchases.
In general, I suggest projectors with minimum 3000+ lumens to begin. Outdoor projections need more brightness of course.
TDScripts by Factory Settings to move camera from TouchDesigner to Blender: th-cam.com/video/olRMbGqgxp0/w-d-xo.html&ab_channel=FactorySettings
Time stamps:
0:00 Overview
2:15 Requirements
3:58 Photogrammetry with RealityCapture
12:02 Clean Mesh in Blender
18:15 3D Mapping with TouchDesigner
29:35 Projector Setup
32:45 CamSchnappr Calibration
42:22 Fine Adjustments with Stoner Tool
44:41 Content Creation
57:36 Outro
มุมมอง: 2 530

วีดีโอ

Projection Mapping with KantanMapper - TouchDesigner Tutorial
มุมมอง 2.9K2 หลายเดือนก่อน
KantanMapper is a tool from the TouchDesigner Palette to create masks for projection mapping. In this video, I use it to project some content on a sculpture that I put together from different shapes - cubes, cirlcles hands and a head. It's pretty straightforward as you basically just create a 2D mask for the area you want to project on - with the right content you can still archieve 3D effects ...
AI Generated Projection Mapping Show
มุมมอง 9184 หลายเดือนก่อน
Clip of a projection mapping on a ~10x30m large building. The mapping content is made with comfyUI, the final mapping done in TouchDesigner. Learn how to create AI Projection Mappings: th-cam.com/video/Usv1ND53H2E/w-d-xo.html Project files and more: www.patreon.com/reflekkt Instagram: reflekkt_
Advanced AI Projection Mapping Workflow
มุมมอง 3.9K4 หลายเดือนก่อน
Generate projection mapping content for any object. Using comfyUI with some mask segmentation and controlnets, you can auto-generate unlimited content. You just need a mask of your projection surface and some style references. Project Files: www.patreon.com/posts/advanced-ai-109356342 My IG: reflekkt_ Overview of the Workflow: 1. Capture a photo from the projector's perspective. ...
Content Creation for Immersive Spaces - comfyUI & Colab Tutorial 2/2
มุมมอง 1.1K5 หลายเดือนก่อน
The second part of this series is all about advanced AI content creation using comfyUI on Google Colab. The Colab Notebook is set up with everything you need for this workflow. Note that you need ~12GB space on your Google Drive. For the workflow file, extra masks and style references check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ Colab Notebook link: drive.goo...
Immersive Space Previsualization - TouchDesigner Tutorial 1/2
มุมมอง 2.1K5 หลายเดือนก่อน
In part 1 of this tutorial series, we build a previsualization setup for an immersive space and learn what format your content needs to have, to be displayed correctly. You get to know what a pixelmap is and be prepared to set this up for your own venues or possible gigs. Part 2 will cover a more advanced content creation technique using comfyUI, an user interface for StableDiffusion. For the p...
Synthetic Sculptors - Interactive Media Installation (TouchDesigner & AI)
มุมมอง 7467 หลายเดือนก่อน
Throughout history, the essence of human beings and the way of its creation has always involved two humans. Yet, artists possess a unique ability to transcend this necessity, forging only one bond between creator and creation. In our exploration, we want to question the creation process, this time engaging the intersection of human and artificial intelligence through the medium of sculpture. He...
Interactive Eye Projection with Webcam or Kinect - TouchDesigner Tutorial 009
มุมมอง 17K9 หลายเดือนก่อน
In this TouchDesigner tutorial, you learn how to create an interactive projection, where an eye follows people passing by. I use a webcam and the bodytrackCHOP to track persons, but you can also use a Kinect or other data like mouse cursor position, noise or any other object. With free AI image generation tools like Bing Image Creator, you can create your own texture, I used PromeAI: www.promea...
Audio Reactive Instancing - TouchDesigner Tutorial 008
มุมมอง 11K11 หลายเดือนก่อน
Learn the technique of instancing combined with audio reactivity. This tutorial guides you step by step and explains easily how to manipulate the instance data with CHOPs for high performance and fps. Color Lovers Picker: derivative.ca/community-post/asset/colour-lover-palette-picker/62697 For more content check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ 0:00 Int...
AI Projection Mapping Tutorial
มุมมอง 24Kปีที่แล้ว
Learn an easy way of creating content for projection mapping with AI and how to map it on an object with TouchDesigner. This method is beginner friendly, quick and gets you impressive results. Have fun experimenting! PromeAI: www.promeai.pro/?vsource=i_8fr8d0f2m7 For more content check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ 0:00 Intro & overview 0:45 Projecto...
Vibrant Color Tunnel - TouchDesigner Tutorial 007
มุมมอง 2.2Kปีที่แล้ว
Beginner friedly tutorial to create a vibrant color tunnel in TouchDesigner. Simply said we instance a noise pattern and give it an interesting appearance by using several patterns for position, rotation and scale of the instances. Add some ambient occlusion and we get this beautiful color tunnel. For more content check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ ...
Northern Lights - TouchDesigner Tutorial 006
มุมมอง 8Kปีที่แล้ว
In this quick and easy beginner tutorial, we recreate the Northern Lights in TouchDesigner in under 5min. For more content check out my Patreon patreon.com/reflekkt and Instagram reflekkt_ 0:00 Intro & Overview 0:20 Base Lines 1:17 Post Effects 4:18 Outro #touchdesigner #northernlights #creativecoding
AI Projection Mapping Show
มุมมอง 1.3Kปีที่แล้ว
A short clip of a projection mapping I showcased at University of Applied Sciences Offenburg during the annual "Werkschau". The contents are mostly generated with help of different AI tools, the mapping is done in TouchDesigner. Thanks to my university@HochschuleOffenburgHSO for providing the technical equipment, projection surface and opportunity to show my semester work :-) For more content c...
Star Galaxy Vortex - TouchDesigner Tutorial 005
มุมมอง 11Kปีที่แล้ว
Star Galaxy Vortex - TouchDesigner Tutorial 005
Audioreactive Kinect Dancer - TouchDesigner Tutorial 004
มุมมอง 12Kปีที่แล้ว
Audioreactive Kinect Dancer - TouchDesigner Tutorial 004
Interactive Nvidia Flex Fluids Inside 3D Objects - TouchDesigner Tutorial 003
มุมมอง 2.5Kปีที่แล้ว
Interactive Nvidia Flex Fluids Inside 3D Objects - TouchDesigner Tutorial 003
Trippy Visuals - TouchDesigner Tutorial 002
มุมมอง 6Kปีที่แล้ว
Trippy Visuals - TouchDesigner Tutorial 002
Interactive Fire Particles - TouchDesigner Tutorial 001
มุมมอง 4.6Kปีที่แล้ว
Interactive Fire Particles - TouchDesigner Tutorial 001
Shifting Nature @ Abendlicht
มุมมอง 4123 ปีที่แล้ว
Shifting Nature @ Abendlicht
Shifting Nature - Interactive Art Installation
มุมมอง 5683 ปีที่แล้ว
Shifting Nature - Interactive Art Installation

ความคิดเห็น

  • @meddenselver8805
    @meddenselver8805 2 วันที่ผ่านมา

    the bodytrack operator is not supported for my gpu

  • @monkeyvision3730
    @monkeyvision3730 6 วันที่ผ่านมา

    amazing .... thanks

  • @monkeyvision3730
    @monkeyvision3730 7 วันที่ผ่านมา

    killa, amazing tutorial....

  • @kristynguyen9623
    @kristynguyen9623 11 วันที่ผ่านมา

    tysm

  • @theboytheycalljonny1
    @theboytheycalljonny1 19 วันที่ผ่านมา

    Great Tutorial - Thank you! What would you recommend I change if I wanted to see how visuals would translate onto a curved wall?

  • @zooeyd.zerlett2037
    @zooeyd.zerlett2037 22 วันที่ผ่านมา

    Cool Solution, Is it possible to add the roof seamless?

    • @reflekkt_net
      @reflekkt_net 22 วันที่ผ่านมา

      @@zooeyd.zerlett2037 sure, just duplicate the floor and move it on top of the walls

  • @tajinderjsingh826
    @tajinderjsingh826 22 วันที่ผ่านมา

    this is coool //thanks

  • @theboytheycalljonny1
    @theboytheycalljonny1 24 วันที่ผ่านมา

    This is great - thanks! Mac user so not able to use Reality Capture it seems. Would love to hear if you have alternative software recommendations.

    • @reflekkt_net
      @reflekkt_net 11 วันที่ผ่านมา

      Hi, I never work on Mac so I can't help with that unfortenately...

    • @theboytheycalljonny1
      @theboytheycalljonny1 11 วันที่ผ่านมา

      @ no worries. Thanks for responding!

  • @joaquimdelima1457
    @joaquimdelima1457 24 วันที่ผ่านมา

    amazing! I would love continue learning with you

  • @scrattyrat
    @scrattyrat 26 วันที่ผ่านมา

    Thanks for this video - fantastic and detailed explanation! I have a question, if I want to install all the dependencies and nodes, checkpoints and modules on my local machine instead of Google Colab (I have a comfyUI install already - the portable one), I assume I can just run the first python script inside my comfyUI folder locally, but with the USE_GOOGLE_DRIVE parameter = false? But what about the second script which installs models / checkpoints, would I need to run this from inside the comfyUI/models folder, or just in the comfyUI folder?

  • @lenas6192
    @lenas6192 หลายเดือนก่อน

    Hey! Quick question: Do I need two monitors for this? I somehow cant output the window and work in the editor at the same time :(

    • @reflekkt_net
      @reflekkt_net หลายเดือนก่อน

      @@lenas6192 No need for 2 monitors. Maybe you click on open as perform window instead of open as second window? Perform mode will only have the output running to save resources, but if you just open as second window you can keep working in the editor.

  • @unveil7762
    @unveil7762 หลายเดือนก่อน

  • @flixytwix
    @flixytwix หลายเดือนก่อน

    Wow thank you so much for all the hard work! This video is super helpful. ❤

  • @CrazyTownXL
    @CrazyTownXL หลายเดือนก่อน

    Nice tutorial! :) Where did you find these joints? (Very curious about that)

    • @reflekkt_net
      @reflekkt_net หลายเดือนก่อน

      @@CrazyTownXL what do you mean with joints? The statue?

    • @CrazyTownXL
      @CrazyTownXL หลายเดือนก่อน

      @@reflekkt_net I mean the things for the projector mount, you have the super clamp and some additional joints/links.

    • @reflekkt_net
      @reflekkt_net หลายเดือนก่อน

      @@CrazyTownXL Ah okay, now I understand. I added links for the components in the description. The only thing I did myself was cutting a plate with holes for the screws to connect the whole thing to my projector. It's super robust, way better than a normal tripod or using some books to kind of place your projector at the right angle 🙂

  • @manuelamontenegro9603
    @manuelamontenegro9603 หลายเดือนก่อน

    amazing tutorial !!! and so easy to follow Thank youuu

  • @luzid.vision
    @luzid.vision หลายเดือนก่อน

    Thats great, thanks for all the hard work!

  • @menybliss
    @menybliss หลายเดือนก่อน

    Wow amazing result!!! takes for put a lot of affort to share with us the all the process of 3D projection.

  • @DePhileas
    @DePhileas หลายเดือนก่อน

    Slaaaaap

  • @davidalanmedia
    @davidalanmedia หลายเดือนก่อน

    That is so cool!

  • @danielaraileanu5770
    @danielaraileanu5770 หลายเดือนก่อน

    Thank you for this detailed explanation! Be blessed!!!

  • @PochoArq
    @PochoArq 2 หลายเดือนก่อน

    I was following your tutorial and I think because I have a MacBook I couldn't advance in the "bodytrack" part. How can I do it? tanks

  • @myasinesin
    @myasinesin 2 หลายเดือนก่อน

    Great tutorial! Thanks. In realtiem viewport i saw seamless loop but when I try to export as video, the loop isn't working. IS there any way to make seamless loop in export?

  • @elydz_
    @elydz_ 2 หลายเดือนก่อน

    amazing thank u

  • @neponel
    @neponel 2 หลายเดือนก่อน

    big thx. keep up the great work. +1 patreon supporter.

  • @jbdemo
    @jbdemo 2 หลายเดือนก่อน

    thanks !!

  • @danisan683
    @danisan683 2 หลายเดือนก่อน

    Great tutorial, thank you so much. If i can ask. What is the proyector that you are using?

    • @reflekkt_net
      @reflekkt_net 2 หลายเดือนก่อน

      I use a NEC ME372W that I scored on ebay for 300euro around 2 years ago. You can do projection mapping with cheap projectors, no need for a fancy setup if you are just learning. Personall I would just not choose a short throw, as the positioning can get weird and can cause lots of shadows if you have a 3D object.

  • @arshinazizi
    @arshinazizi 2 หลายเดือนก่อน

    Fantastic thank you so much 🎉 appreciate your time ... How you make video for this physical object.do you do 3D scan of your object ? Or do another way? Thanks in advance for your response🙂🙏🏻

    • @reflekkt_net
      @reflekkt_net 2 หลายเดือนก่อน

      It's made with the comfyUI workflow I mention in the beginning and needs only one image as input, no need for a 3D scan.

  • @rameshdevasi6720
    @rameshdevasi6720 2 หลายเดือนก่อน

    if we make ring of projectors pointed toward a big sculpture, it would be cool.

    • @reflekkt_net
      @reflekkt_net 2 หลายเดือนก่อน

      Multi projector setups are next on my list : )

  • @menybliss
    @menybliss 2 หลายเดือนก่อน

    Great one! will like to see more on the KantanMapper with multi textures, layer duplications and more.....

    • @reflekkt_net
      @reflekkt_net 2 หลายเดือนก่อน

      Thank you! Yes, this video is very basic, I'll cover more about TouchDesigners mapping tools soon!

  • @ramim.5856
    @ramim.5856 2 หลายเดือนก่อน

    I was really looking for this thanks 😊

  • @TheGladScientist
    @TheGladScientist 2 หลายเดือนก่อน

    Looks great! Ready for the stage 🤘🏼

  • @sudabadri7051
    @sudabadri7051 2 หลายเดือนก่อน

    Super cool stuff

  • @AtelieristaMHP
    @AtelieristaMHP 2 หลายเดือนก่อน

    could this work with MediaPipe (different body parts tracking) and with multiple people ?

    • @reflekkt_net
      @reflekkt_net 2 หลายเดือนก่อน

      sure, you can just use the position coming from mediapipe instead of a kinect. It is also possible to adjust the project file to work with multiple people, as you can create multiple eye actors with their own bullet solver systems and position inputs. Once you get the idea behind this tutorial, you will be able to extend it :-)

  • @usahome
    @usahome 2 หลายเดือนก่อน

    Wow! Subscribed. 👍

  • @final_animal
    @final_animal 3 หลายเดือนก่อน

    Hi, thanks so much for these tutorials! It's really helpful seeing a practical example of how it all works, thanks a million. I'm trying to estimate costs for an installation of a similar size, do you happen to have info on the type of projectors and media servers used here, and how many of each was needed? I'd also love to hear any info on the projection wall fabric. Much appreciated man, subbed to the TH-cam and Patreon, this is really great content and beautiful work as well.

    • @reflekkt_net
      @reflekkt_net 3 หลายเดือนก่อน

      Thanks a lot, I appreciate it! I have access to the room though my master studies (Digital Art & Creative Technologies at La Salle Barcelona in case someone is interested) and can't tell you much about costs, but they use Watchout as media server system. Write me a message, I can probably get some more infos about hardware as well.

  • @sarah-lo8fj
    @sarah-lo8fj 3 หลายเดือนก่อน

    Nice tutorial! How can I remove the backgroud, so that only the silouette is showing?

    • @asthettic
      @asthettic หลายเดือนก่อน

      you need a kinect, or if on a beefy pc with nvidia you could use the Nvidia background Top

  • @alexandrupop7461
    @alexandrupop7461 3 หลายเดือนก่อน

    When I click start to make the eye follow the geometric position the eye is folloing the eye for a milisec and after that the eye goes far away, why is this happening?

  • @shivamm697
    @shivamm697 3 หลายเดือนก่อน

    so cool can i know the name of the application? and where to download it

  • @nutvers1.0n
    @nutvers1.0n 3 หลายเดือนก่อน

    Where do you place your webcam/kinect to the wall?

    • @reflekkt_net
      @reflekkt_net 3 หลายเดือนก่อน

      I placed mine centered around 4m away from the wall

    • @nutvers1.0n
      @nutvers1.0n 3 หลายเดือนก่อน

      ​@@reflekkt_net thanks

  • @wembley2750
    @wembley2750 4 หลายเดือนก่อน

    Can I add a background video?

  • @showsnsdespa3
    @showsnsdespa3 4 หลายเดือนก่อน

    It's not working the body tracking :c i don't have gpu nvidia... is there any other way?

    • @reflekkt_net
      @reflekkt_net 4 หลายเดือนก่อน

      You could try the MediaPipe plugin, I think it works for Mac too. I never used Mac tho, so not 100% sure.

  • @canadave9
    @canadave9 4 หลายเดือนก่อน

    What a cool tutorial thank you!

  • @ahphiell
    @ahphiell 4 หลายเดือนก่อน

    Wow I've always wondered about this, thank you so much!

  • @vilimomo1696
    @vilimomo1696 4 หลายเดือนก่อน

    Light through the vains jon Hopkins similar project, like a traveling asteroid

  • @vilimomo1696
    @vilimomo1696 4 หลายเดือนก่อน

    Faping prohibited lol

  • @keshav2136
    @keshav2136 4 หลายเดือนก่อน

    Can't believe how useful Kinect was! Great video. Subscribed.

  • @XteVision
    @XteVision 4 หลายเดือนก่อน

    nice mapping instruction. I like it a lot.

  • @aaavisuals2950
    @aaavisuals2950 4 หลายเดือนก่อน

    Dope!!

  • @linggem431
    @linggem431 4 หลายเดือนก่อน

    Thanks a lot. Clear and concise. This tutorial helped me to get the perfect effect and more improtantly, I finally understand the use of point transform. And the use of Bloom is also very inspiring.

  • @joseignacioarias6644
    @joseignacioarias6644 4 หลายเดือนก่อน

    wonderful workflow! Thank you for explaining your ComfyUI network. How can this workflow work for automatic dome mapping, or not so auto dome mapping? *sorry my bad english