Audio Reactive Animations with Stable Diffusion and TouchDesigner - Tutorial 3

แชร์
ฝัง
  • เผยแพร่เมื่อ 26 ม.ค. 2025

ความคิดเห็น • 38

  • @Interface3072
    @Interface3072 ปีที่แล้ว +3

    Incredible work and fantastic tutorial - thanks so much for sharing!

  • @sampak6839
    @sampak6839 2 ปีที่แล้ว +1

    This is so exciting, can't wait to try it tomorrow. I am sure it will be super fun, thanks!

  • @rufiyan
    @rufiyan ปีที่แล้ว

    you're the greatest man for this

  • @jonas8732
    @jonas8732 ปีที่แล้ว

    i literally can not express how much i needed this tutoria.. thank you soo much!!!!!

  • @nicolaseastland1447
    @nicolaseastland1447 2 ปีที่แล้ว

    Super cool technique.
    For sure looking forward to trying it out.

  • @alexeyparkhomenko6237
    @alexeyparkhomenko6237 ปีที่แล้ว

    great tutorial, thanxx!

  • @RisteardOhA
    @RisteardOhA 2 ปีที่แล้ว

    Incredible, thanks for sharing!

  • @matthewortega4858
    @matthewortega4858 ปีที่แล้ว +2

    Added my own API key but doesn't seem to be working. Am I missing anything?

  • @BenHeim
    @BenHeim 2 ปีที่แล้ว

    Amazing stuff mate! Thanks for building such awesome comps

  • @hobohippy1616
    @hobohippy1616 2 ปีที่แล้ว

    boom cheers for the inspiration

  • @vongolance
    @vongolance ปีที่แล้ว +2

    Hey Torin, amazing tutorial! Can this be run on local stable diffusion? So there is no need to go through computerender?

  • @raamsanghani9187
    @raamsanghani9187 ปีที่แล้ว +1

    Thanks for the tutorial man! I did have a question - for me, I'm noticing that the transform zooming in effect doesn't quite seem to be working for me, nor does the rotation 🤔Anything that might be good to check out?
    Update: nvm - I had the cross all the way up to 1 which is why nothing seemed to be happening 😅

  • @brandon_stargrave
    @brandon_stargrave ปีที่แล้ว +3

    I've been trying to work at 720x1280, which actually seems to come back as 704 x 1280, no big deal. But once in a while, when I start recording with the MovieFileOut, the resolution randomly changes to 320x640. Haven't been able to track down what's causing it, but there's definitely some strangeness with the resolution.

    • @blankensmithing
      @blankensmithing  ปีที่แล้ว +1

      The size auto rounds to the nearest power of 2. When you're using img to img it only looks at the resolution of your video

    • @aaronc.1362
      @aaronc.1362 ปีที่แล้ว

      @@blankensmithing So how to fix this, i faced the same problem and the resolution is unuseable.

    • @blankensmithing
      @blankensmithing  ปีที่แล้ว +1

      @@aaronc.1362 The max resolution with img 2 img on is apparently 768 X 768. You can use a Fit TOP to resize your input. When img 2 img is turned on it uses the resolution of the input instead of the resolution you specified on the computerender component

  • @michaelhyp765
    @michaelhyp765 ปีที่แล้ว

    Hello Torin! This is fantastic, thank you for the clear tutorial! - when I use the transform/scaling feature my image starts to degrade. Is there a viable workaround to keep the images at a consistent res through the animation?

    • @blankensmithing
      @blankensmithing  ปีที่แล้ว +1

      Hey make sure the seed is changing every time

  • @MrBloodmonster
    @MrBloodmonster 2 ปีที่แล้ว

    Thanks for your tutorial! how far do you think we can do this real time, with low request cost and not neccesarily expensive harrware need it
    thank you

  • @youngp7510
    @youngp7510 ปีที่แล้ว

    when i generate images , every iterations is super different , either i put the strenght super low and i only get one frame , like at 0.01 or if it is around 0.1 it just changes image every time , i cant seem to make slight changes to images any ideas on solutions?

  • @bartholome3652
    @bartholome3652 ปีที่แล้ว

    When I try to use a seed from an image from Lexica, I often get an error. Happens when the seed is very high. I guess the seed can't exceed a certain number. Any workaround?

  • @bartholome3652
    @bartholome3652 2 ปีที่แล้ว

    Very nice tutorial. Much appreciated!
    Do you know why sometimes it takes very long for the computerender to push out images?

    • @blankensmithing
      @blankensmithing  2 ปีที่แล้ว +1

      thanks! I'm assuming this video brought a lot more active usage happening at the same time. In general I've found it to be very responsive :)

    • @bartholome3652
      @bartholome3652 ปีที่แล้ว

      @@blankensmithing Thanks for your reply. Works better now!

  • @Cazametroides
    @Cazametroides ปีที่แล้ว

    Hey man! Great video! Would be amazing if you could give some info into how to adapt this setup for running Stable Diffusion locally

    • @blankensmithing
      @blankensmithing  ปีที่แล้ว +1

      Check out @dotsimulate's setup. He has a local setup you can use. I wanted to make sure this was accessible to the most number of people so I went with an API

  • @dougeasterly
    @dougeasterly ปีที่แล้ว

    whose paintings are those?

  • @marcomelilli166
    @marcomelilli166 8 หลายเดือนก่อน +1

    thank you very much for sharing this project, I tried to generate images and everything worked correctly until yesterday. Despite I added credits on computerender, since today, when I generate an image I get an error back “ {”status“: ‘error’, ‘message’: ‘Could not find \’complete\” state within timeout. You may try again.", ‘errorType’: ‘INTERNAL_ERROR’, ‘jobId’: ‘60f87997ecc64cba35e185a74ed0a4498c1b89e5’} ‘ ’, could you tell me how to fix it?
    thank you very much, i love your channel!

    • @bardoof
      @bardoof 8 หลายเดือนก่อน

      I've the very same problem. It worked correctly until few hours ago...

  • @ArgoBeats
    @ArgoBeats 2 ปีที่แล้ว

    Beautiful, thank you Torin! Is this kind of Audio Reactive Animation possible even in real time, say for a live event while playing a midi device?

    • @blankensmithing
      @blankensmithing  2 ปีที่แล้ว +3

      Thanks! At the moment the plugin uses an API, so you don't need to have a fancy GPU to run it and it'll run on Mac + PC. It'll generate the images at around ~3fs. The API is running the model mainly on RTX 3090s, so it's not quite there for real-time yet unless you kept the resolution really low, or the iterations low. I'm not sure how fast the model runs on a 4090 though.
      I'm sure in the near future there'll be some optimizations that'll bring things closer to real-time.

    • @ArgoBeats
      @ArgoBeats 2 ปีที่แล้ว

      @@blankensmithing great to hear, thank you again Torin.

  • @outsandatv
    @outsandatv 2 ปีที่แล้ว

    Great tutorial format and explaination ! I think the vidéo deserves to be a bit shorter in lenght but overall it's great !

  • @ryhorvaladzko
    @ryhorvaladzko 10 หลายเดือนก่อน

    Error: (Parameter: Experimental) AttributeError: 'td. App' object has no attribute 'experimental'
    (/project1/computerender/docsHelper)

  • @ThePinnxx
    @ThePinnxx ปีที่แล้ว

    Hello, Im running a 2021 version of Touchdesigner that is paid for, cant afford the update as yet.. having lots of errors running the program on this version, is there a workaround I wonder?

    • @blankensmithing
      @blankensmithing  ปีที่แล้ว +1

      i’ve only tested this on newer versions of TD

    • @JannatShafiq-fr4lr
      @JannatShafiq-fr4lr 8 หลายเดือนก่อน

      @@blankensmithing Hey can u plzz give the link for that version?