Directional Motion Detection and Tracking using Webcam in TouchDesigner

แชร์
ฝัง
  • เผยแพร่เมื่อ 17 ธ.ค. 2024

ความคิดเห็น • 68

  • @FunctionStore
    @FunctionStore  2 ปีที่แล้ว +4

    Just noticed that from 5:15 onwards the CHOP channels are showing 0 - but this is only a visual bug due to the recording being in 30 FPS and my project file in 60, so we just happen to miss the frames it shows values :D Gets more clear once I put down the Filter CHOP

  • @JBroadway
    @JBroadway ปีที่แล้ว +2

    Thank you for making this. I found it very helpful! I hope you continue to make more.

  • @rgrant
    @rgrant ปีที่แล้ว +2

    Great, just what I was looking for!

  • @matildemasenello948
    @matildemasenello948 4 หลายเดือนก่อน +4

    Hi! I just finished watching your tutorial but unfortunately I can't understand how you managed to connect the circle to the particles to use it as an element that dictates the movement. Could you help me?

  • @jimmysimmons6477
    @jimmysimmons6477 2 ปีที่แล้ว +1

    Love the breakdown, thank you!

  • @michaelcarnohan
    @michaelcarnohan 5 หลายเดือนก่อน +1

    Nice tutorial! Clean implementation of Optical Flow.
    May I suggest bypassing components like your Analyze TOPS when they result in flickering like this in the future... some folks have Epilepsy and this can be a trigger. 🙏

    • @FunctionStore
      @FunctionStore  5 หลายเดือนก่อน +1

      Thanks! Yep totally!

  • @sarahghazi5539
    @sarahghazi5539 10 หลายเดือนก่อน +2

    Hello! Love the tutorial. I just have a bit of trouble with the analyze TOP. Mine is not blinking the way yours is and when I put the top to CHOP, it gives me an error of 'invalid source TOP specified. Love if anyone can help. Thanks!

  • @olwaysoliver6880
    @olwaysoliver6880 ปีที่แล้ว +5

    thanks for the video! i am having trouble with a lot of noise i think.. The thresholds pick up much more flickering visual than yours do, i have tried to adjust my room lighting without real success.. Do you think my webcam is just bad? there is really a lot of bright flashing images in my threshold frames, but i am in a calm and soft lit environment i tried the blur filter but it really didnt do much.. what can i do?

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      Hey, hard to tell without seeing but might be the case with a lot of digital noise from the camera. You could try adding a little bit of feedback to your input image to average the noise a bit more. As last resort if you have an RTX GPU you can try the nvidia denoise top, but would make sure to decimate the resolution to at least half before with a resolution TOP.

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว +2

      how about changing the Optflow Lambda and threshold?

    • @js4741
      @js4741 9 หลายเดือนก่อน +2

      Hey, just wanted to share I was having the same issue with my built-in webcam (Macbook M1 Pro). A ton of flickering visual from the threshold nodes.
      FunctionStore's suggestion of changing the threshold in the optflow was really helpful. The default optflow threshold value is 0 and I was getting a ton of flickering. As soon as I changed my threshold to 0.004, suddenly my threshold nodes looked a lot more like they do in the youtube video, with just the outline of me/my hand at a lot less noise. Hope this helps someone!

  • @hernancrocce
    @hernancrocce 8 หลายเดือนก่อน +1

    Hi there. Lovely tutorial and well explained!
    Out of curiosity...What would be a workaround to use also the depht/z axis with the optical flow tool?

    • @FunctionStore
      @FunctionStore  8 หลายเดือนก่อน +1

      Hey thanks! Using this method only I don't think would necessarily be possible to get depth information. Also since this tutorial aired I recommend people to check out MediaPipe

  • @markus_knoedel
    @markus_knoedel 2 ปีที่แล้ว

    Thank you. Good stuff.

  • @Jacobcuz
    @Jacobcuz 5 หลายเดือนก่อน +2

    Thanks for this tutorial. My circle seems to be stuck in the top right hand corner once plugging in the null to the center. Do i need to just adjusting the settings as you mentioned? I'm using a 2023 Macbook pro with built in camera. Any help would be great thank you!

    • @CameronByers_UM
      @CameronByers_UM หลายเดือนก่อน

      I have the same issue, did you figure this out?

  • @SandervanLaarpixellaar
    @SandervanLaarpixellaar 4 หลายเดือนก่อน

    nice work! is this also possible with a image and when you walk by change in liquid?

    • @FunctionStore
      @FunctionStore  4 หลายเดือนก่อน

      @@SandervanLaarpixellaar sure, anything is possible that you can/want to control with a chop

    • @SandervanLaarpixellaar
      @SandervanLaarpixellaar 4 หลายเดือนก่อน

      @@FunctionStore thnx i hope so! because i have a great idea

  • @Skins4497
    @Skins4497 4 วันที่ผ่านมา

    Can you make a tutorial on how to connect it with a 3D connected with fragments/sprinkles and make the 3d object disintegrate with the hand motion ? Idk if that’s possible 😅

    • @FunctionStore
      @FunctionStore  4 วันที่ผ่านมา

      @@Skins4497 everything is possible but it's too specific for me to make a tutorial on. There's a ton of similar effects out there as tutorials, and connecting them with interactivity is always possible

    • @Skins4497
      @Skins4497 3 วันที่ผ่านมา

      @ thank you for responding. Do you do a projects for payment ? I need to make a project for my thesis and I have following plenty of tutorials but I cannot connect different functions with each other. I am a newbie 😅. If you do can I send you a message on your social media accounts? Thanks in advance

    • @FunctionStore
      @FunctionStore  3 วันที่ผ่านมา

      @Skins4497 feel free to reach out, if not me, I can recommend someone for sure

  • @dingwenxiao5660
    @dingwenxiao5660 ปีที่แล้ว +1

    Can you make a tutorial on how to do this particle effect with Azure Kinect? THANKS~~!

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      If you mean the thing you see on the right: check out Noonesimg's tutorials on flex.

  • @jamieguterman9598
    @jamieguterman9598 8 หลายเดือนก่อน

    Great video! Once I make a particle system, where do I attach it?

    • @FunctionStore
      @FunctionStore  8 หลายเดือนก่อน

      Thanks! That's the beauty of TD, you can attach anywhere! But in my case I was controlling the gravity of an Nvidia Flex system.

    • @jamieguterman9598
      @jamieguterman9598 8 หลายเดือนก่อน

      @@FunctionStore Thank you for the advice! I was able to attach the motion tracking to an eye visual I created following this tutorial: th-cam.com/video/3ptfQFkNaHc/w-d-xo.html . When The eye moves with my body / hand, I'm getting a looottt of drag on the visuals. Is there a way to fix this?

  • @unclefillTV
    @unclefillTV 2 ปีที่แล้ว

    I am not seeing an option for ‘CHOP Reference’ when I right click “center” in my Circle TOP as you show at 13:17. Are you right clicking there? I get different options. Would love to finish this!

    • @FunctionStore
      @FunctionStore  2 ปีที่แล้ว +1

      Hey! I am dragging the CHOP channel onto the parameter. Be sure to activate the viewer of the CHOP (null1, to activate click the little star icon at the bottom right of the operator) and then drag the channel you want to reference!

    • @unclefillTV
      @unclefillTV 2 ปีที่แล้ว

      @@FunctionStore wow! I think I got it. My next question would be, how to get the final effect as you show at the beginning of the tutorial? I’m finally able to move my ball so thank you!! Any help there?

    • @unclefillTV
      @unclefillTV 2 ปีที่แล้ว

      Or does that need it’s own tutorial? 😅

    • @FunctionStore
      @FunctionStore  2 ปีที่แล้ว

      @@unclefillTV do you mean the particles on the right of the screen? Check this tutorial for the basic setup: th-cam.com/video/0ym50KEXi48/w-d-xo.html I am controlling the gravity of the system (no speed CHOP needed in this case just math to multiply the values)

  • @apofis_media
    @apofis_media หลายเดือนก่อน

    nice one, but how the first visual as example was made ?

    • @FunctionStore
      @FunctionStore  หลายเดือนก่อน

      @@apofis_media please read description

  • @so0ofii
    @so0ofii 3 หลายเดือนก่อน

    hi, I was wondering if there could be some expresion that help me with the borders of the circle, it keeps going off the field. Anyone knows?

  • @femi8637
    @femi8637 9 หลายเดือนก่อน

    Hi, great tutorial thanks! I am unable to make all the operators a component, there is no drop down option- could you let me know how to do this? TD newbie here!

    • @FunctionStore
      @FunctionStore  8 หลายเดือนก่อน +1

      hey, sorry not sure what you mean, probably best to watch more beginner courses and come back!

    • @femi8637
      @femi8637 8 หลายเดือนก่อน

      @@FunctionStore okay thank you for your reply!

  • @Kancha1996
    @Kancha1996 10 หลายเดือนก่อน

    Can you show how to make basicFlex of your work on video, please?

    • @FunctionStore
      @FunctionStore  10 หลายเดือนก่อน

      Please check description

    • @Kancha1996
      @Kancha1996 10 หลายเดือนก่อน

      @@FunctionStore yes I watch it but idk how to make it move with circle. sry but I'm newbie about this program. 😅

    • @FunctionStore
      @FunctionStore  10 หลายเดือนก่อน

      @@Kancha1996 I was controlling the gravity of the flex system

  • @streamingdev1163
    @streamingdev1163 ปีที่แล้ว

    I just bought the paetron for this video, what do I do next to get the pixels like you were showing at the beginning of the video?

    • @streamingdev1163
      @streamingdev1163 ปีที่แล้ว +1

      I am confused on why you didnt show the ability to attach the particles either, very new to TD so kinda confused on what to do next

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      @@streamingdev1163 it was just a quick example to show the kind of interaction you can integrate. The visuals are based on an Nvidia Flex tutorial (and Patreon content so it's unethical to share anyway) linked in the description from Noonesimgs.
      In this video I never claim to share any of the visuals, only ever talk about the interactive component.
      TD has a very steep learning curve but once you reach a certain point you will never want to do anything else so keep on keeping on!

  • @aldyferdiansyah5133
    @aldyferdiansyah5133 ปีที่แล้ว

    Hi, I'm a new user of TouchDesigner. How do I connect Motion Detection with Nvidia Flex, and are there any tutorials available for this?

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      Hey just connet the output of this tutorial to the gravity or any parameters of the flex you like (probably with some Matb CHOP to get the value in range) . In the description there is a flex tutorial.

  • @saurabhsswami
    @saurabhsswami 5 หลายเดือนก่อน

    Hey! I followed your steps but my result is very janky and had to use another method

  • @sliderpox7758
    @sliderpox7758 ปีที่แล้ว

    Do you know if the circle only tracks 1 person at a time, or can I make it follow multiple hands?

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      Hi it only follows general movement in the camera view. It's not tracking anything in the literal sense so no.

  • @nadijasafaryan2926
    @nadijasafaryan2926 ปีที่แล้ว

    I have no source names for the NDI in... how can I fix that?

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว +1

      Hey I'm only using NDI because my camera image was already occupied by my recording software. You can just use Video Device In TOP for example

    • @nadijasafaryan2926
      @nadijasafaryan2926 ปีที่แล้ว

      ​@@FunctionStore thank you for your reply. I'm a student who just started with TouchDesigner for a project. Do you maybe have another tutorial on how to make the blue wavy design, like in the thumbnail?

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      @@nadijasafaryan2926 Right, based on this tutorial: th-cam.com/video/0ym50KEXi48/w-d-xo.html good luck and have fun!

  • @artnomalie
    @artnomalie ปีที่แล้ว

    Can this be done without optical flow (i am on mac :) ?

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      Optical Flow from the palette should work on mac!

  • @ghassanterek4675
    @ghassanterek4675 ปีที่แล้ว

    how did you create the null component

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      select an operator, then hit alt+N hotkey

  • @zasmorning
    @zasmorning 4 หลายเดือนก่อน

    after all the steps, my math TOP only works in positive, not negative... 0, +1, 0 +1 and O dont know why

  • @Anckg
    @Anckg ปีที่แล้ว

    Do you mind showing us how you did merge the tutorial (th-cam.com/video/0ym50KEXi48/w-d-xo.html) and the motion tracking bits together? I've been stuck on it for quite some time, I'm new to TD :]

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      I was controlling the gravity I think

    • @olwaysoliver6880
      @olwaysoliver6880 ปีที่แล้ว

      would love some help with that aswell, i have been trying to combine these two
      did you manage to do it?

    • @FunctionStore
      @FunctionStore  ปีที่แล้ว

      @@olwaysoliver6880 I'm controlling the Nvidia Flex Solver's Gravitational Acceleration parameters with the LR/UD channels (multiplied by 5 and having a filter with width of 1)