Audioreactive AnimateDiff video clips with ComfyUI (AI Music Videos)

แชร์
ฝัง
  • เผยแพร่เมื่อ 6 ก.ย. 2024
  • Create unbelievable visuals for music videos using this audio reactive workflow for ComfyUI and AnimateDiff.
    Using the audio nodes from SaltAI, masks can react to different audio frequencies following the rythm of the music. In combination with IP Adapter and AnimateDiff, exciting video clips and compositions can be made.
    Unleash the power of Stable Diffusion with ComfyUI and AnimateDiff.
    You can download the video and audio I use in the tutorial here:
    ko-fi.com/s/7d...
    💻 AnimateLCM: tinyurl.com/y4...
    💻 IP Adapter plus: tinyurl.com/2z...
    📡 Salt.ai: getsalt.ai/
    🕸️ Discord: / discord
    #animatediff #comfyui #stablediffusion
    ============================================================
    💪 Support this channel with a Super Thanks or a ko-fi! ko-fi.com/koal...
    ☕ Amazing ComfyUI workflows: tinyurl.com/y9...
    🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. tinyurl.com/58... 🤗
    ☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
    👉 RunDiffusion: tinyurl.com/yp... 👉15% off first month with code 'koala15'
    👉 ThinkDiffusion: tinyurl.com/4n...
    🤑🤑🤑 FREE! Check my runnable workflows in OpenArt.ai: tinyurl.com/3j...
    The best ai animation tutorial!
    Learn how to make comfyui animation workflow
    and use controlnet stable diffusion prompts
    ComfyUI: best open source animation software for pc
    ============================================================
    CREDITS
    ===========================================================
    🎵Music
    Song: Bike Box, Artist: Kia, Music by: CreatorMix.com
    It's Our Time, Music by CreatorMix.com
    ✂️ Edited with Canva, and ClipChamp. I record the stuff in powerpoint.
    ========================================================
    © 2024 Koala Nation
    #comfyui #animatediff #stablediffusion

ความคิดเห็น • 22

  • @joshlbiomechanic
    @joshlbiomechanic 24 วันที่ผ่านมา

    Hmm, with this you animate every instance in a song, not to mention stereo imaging as well! Thankyou for this, i will be watching this many times over

    • @koalanation
      @koalanation  24 วันที่ผ่านมา +1

      @@joshlbiomechanic enjoy it! It is a bit complicated but it is worthwhile to learn in and outs so you can come up with new solutions!

    • @joshlbiomechanic
      @joshlbiomechanic 24 วันที่ผ่านมา

      @@koalanation do think we can use a midi file as a signal?

  • @jagsAImagic
    @jagsAImagic 2 หลายเดือนก่อน +2

    pretty cool way to sync masks with audio and create a reactive music video. awesome.

    • @koalanation
      @koalanation  2 หลายเดือนก่อน +1

      Top! Love your videos!

  • @aivideos322
    @aivideos322 หลายเดือนก่อน

    You do a great job of explaining things. Well done

  • @liangmen
    @liangmen หลายเดือนก่อน

    Amazing video tutorial, took two days to implement it and get it working now. Although still not quite understand some bits of it. Again, brilliant video, thank you so much!

    • @koalanation
      @koalanation  หลายเดือนก่อน

      @@liangmen Happy to hear you managed to get it working. It is not easy, definitely

  • @Official-PRIMZ
    @Official-PRIMZ 2 หลายเดือนก่อน

    😮 Thats awesome🙏. Will try it soon 😏

    • @koalanation
      @koalanation  2 หลายเดือนก่อน

      @@Official-PRIMZ good luck! Many cool things can be done with some imagination!

  • @visualdrip.official
    @visualdrip.official หลายเดือนก่อน

    hello, im wondering where the link is for the mask video?

    • @koalanation
      @koalanation  หลายเดือนก่อน

      You can download: ko-fi.com/s/7d5e1802f1
      Use 0 if you want download it for free

    • @visualdrip.official
      @visualdrip.official หลายเดือนก่อน

      @@koalanation thank you ! it will repeat on seamless loop? or its better without the loop?

    • @koalanation
      @koalanation  หลายเดือนก่อน +1

      @@visualdrip.official in the example the mask video is repeated several times so it seems it is looping. But you can also choose to have a 'static' mask, or to have a different one without looping...do what you like!

    • @visualdrip.official
      @visualdrip.official หลายเดือนก่อน

      @@koalanation thanks so much for sharing!

  • @VaibhavShewale
    @VaibhavShewale 2 หลายเดือนก่อน +1

    only if i had a good system!

    • @koalanation
      @koalanation  2 หลายเดือนก่อน

      @@VaibhavShewale yep, it is heavy. The animation stuff at the end eats a lot of resources...

    • @VaibhavShewale
      @VaibhavShewale 2 หลายเดือนก่อน

      @@koalanation damn dude the hour of editing you have spent is just on next level

    • @joshlbiomechanic
      @joshlbiomechanic 24 วันที่ผ่านมา

      @@VaibhavShewalethere are some comfyui cloud sites you process your workflow on, never tried it yet though…