- 140
- 53 268
ThatClaireLee
United States
เข้าร่วมเมื่อ 3 พ.ค. 2023
[Dancing Morph Tutorial] Discover How Everything Can Dance!
In this video, we'll walk through creating a dancing morph video and share some personal tips. We'll start with a workflow overview, fine-tune key parameters, then I'll share tips for seamless results and wrap up with a showcase.
0:00 Tutorial outline
0:30 Workflow overview
1:00 Workflow overview - Inputs group
1:47 Workflow overview - Extract Target Object group
2:06 Workflow overview - IPAdapter Group
2:22 Workflow overview - Controlnet Group
2:39 Workflow overview - AnimateDiff Group
2:47 Workflow overview - Upscale Group (Optional)
3:21 Fine-tuning parameters overview
3:33 Fine-tuning parameters - Object and background images
5:00 Fine-tuning parameters - IPAdapter weight
6:42 Fine-tuning parameters - Openpose strength
8:12 Fine-tuning parameters - AnimateDiff motion lora
9:53 Fine-tuning parameters - KSampler denoise
10:39 Extra tricks
11:40 Showtime
*YokoAI workflow*
openart.ai/workflows/hound_red_82/wheat-ears-dancing-on-the-plate/6wrwRomvIISyj0SaUAwz
*My Reorganized workflow*
drive.google.com/file/d/1wmz2XsqFs86xRawWDWPPm1W_933KWEw9/view?usp=sharing
*Model*
Juggernaut:
civitai.com/models/46422/juggernaut
*AnimateDiff Motion Lora*
shatter motion lora:
civitai.com/models/312519/shatter-or-animatediff-motion-lora
run motion lora:
civitai.com/models/476267/run-motion-lora-for-animatediff
explosive motion lora:
civitai.com/models/344203/explosive-or-animatediff-motion-lora
#aianimation #animation #aiart #stablediffusion #animatedvideo #animatedvideos #comfyui #anime #animatediff #ipadapter #vid2vid #dance #dancing #dancevideo #dancemorph #dancingmorph #morph #turorial #everythingcandance
0:00 Tutorial outline
0:30 Workflow overview
1:00 Workflow overview - Inputs group
1:47 Workflow overview - Extract Target Object group
2:06 Workflow overview - IPAdapter Group
2:22 Workflow overview - Controlnet Group
2:39 Workflow overview - AnimateDiff Group
2:47 Workflow overview - Upscale Group (Optional)
3:21 Fine-tuning parameters overview
3:33 Fine-tuning parameters - Object and background images
5:00 Fine-tuning parameters - IPAdapter weight
6:42 Fine-tuning parameters - Openpose strength
8:12 Fine-tuning parameters - AnimateDiff motion lora
9:53 Fine-tuning parameters - KSampler denoise
10:39 Extra tricks
11:40 Showtime
*YokoAI workflow*
openart.ai/workflows/hound_red_82/wheat-ears-dancing-on-the-plate/6wrwRomvIISyj0SaUAwz
*My Reorganized workflow*
drive.google.com/file/d/1wmz2XsqFs86xRawWDWPPm1W_933KWEw9/view?usp=sharing
*Model*
Juggernaut:
civitai.com/models/46422/juggernaut
*AnimateDiff Motion Lora*
shatter motion lora:
civitai.com/models/312519/shatter-or-animatediff-motion-lora
run motion lora:
civitai.com/models/476267/run-motion-lora-for-animatediff
explosive motion lora:
civitai.com/models/344203/explosive-or-animatediff-motion-lora
#aianimation #animation #aiart #stablediffusion #animatedvideo #animatedvideos #comfyui #anime #animatediff #ipadapter #vid2vid #dance #dancing #dancevideo #dancemorph #dancingmorph #morph #turorial #everythingcandance
มุมมอง: 34
วีดีโอ
[AI Art Styles] Woodblock Print Style Animation | Power Over Justice | Green Terror | Taiwan
มุมมอง 18หลายเดือนก่อน
[AI Art Styles] Woodblock Print Style Animation | Power Over Justice | Green Terror | Taiwan
[AI Art Styles] Gemma Correll Style Animation | Virtual Vlog
มุมมอง 137หลายเดือนก่อน
[AI Art Styles] Gemma Correll Style Animation | Virtual Vlog
[AI Art Styles] Doodle Style Animation | $$$$$$ Dream
มุมมอง 25หลายเดือนก่อน
[AI Art Styles] Doodle Style Animation | $$$$$$ Dream
[AI Art Styles] Crayon Style | Sketch My Soul: From Doodle to Surrealism
มุมมอง 792 หลายเดือนก่อน
[AI Art Styles] Crayon Style | Sketch My Soul: From Doodle to Surrealism
Sweet but Psycho | Clay Version Music Video | AI Clay Animation | 黏土動畫
มุมมอง 723 หลายเดือนก่อน
Sweet but Psycho | Clay Version Music Video | AI Clay Animation | 黏土動畫
WOW! AI Reinvents Famous Paintings In Clay! | Stable diffusion | Clay Style
มุมมอง 524 หลายเดือนก่อน
WOW! AI Reinvents Famous Paintings In Clay! | Stable diffusion | Clay Style
Image to Clay | Stable diffusion | Clay Style
มุมมอง 734 หลายเดือนก่อน
Image to Clay | Stable diffusion | Clay Style
Clay Models | SVD | AI Clay Animation | 黏土動畫
มุมมอง 554 หลายเดือนก่อน
Clay Models | SVD | AI Clay Animation | 黏土動畫
Ballerina | AnimateLCM | IP-Adapter | vid2vid
มุมมอง 2957 หลายเดือนก่อน
Ballerina | AnimateLCM | IP-Adapter | vid2vid
[AnimateAnyone] Unlock the Dance Formula: 1 Image + DWPose Frames = Spectacular Dance Video Magic!
มุมมอง 3.8K7 หลายเดือนก่อน
[AnimateAnyone] Unlock the Dance Formula: 1 Image DWPose Frames = Spectacular Dance Video Magic!
Captivating Logo Animation | Happy Valentine's Day Special Edition!
มุมมอง 498 หลายเดือนก่อน
Captivating Logo Animation | Happy Valentine's Day Special Edition!
[Animate Anyone] Magic! 1 Image + DWpose Frames = Spectacular Dance Video
มุมมอง 7648 หลายเดือนก่อน
[Animate Anyone] Magic! 1 Image DWpose Frames = Spectacular Dance Video
Which app
Hi, I don't use any app for this. Instead, I use the workflow shown below along with a local ComfyUI environment. You can check out the tutorial here. *Workflow* openart.ai/workflows/hound_red_82/wheat-ears-dancing-on-the-plate/6wrwRomvIISyj0SaUAwz *Tutorial* th-cam.com/video/opR0fe5Yym4/w-d-xo.html
That was scary but low-key cool Lol 😂
This has no right being tagged under animation
wtf
What was the guy in the back looking at?
This is pure shit
Wtf
Don't have it for Android?
Ai isn’t art it’s image generation.
It's beautiful 😍 your dancing and the art
Probably ai
Hi, the following error appears when I run the workflow, and it highlights the "Math" and "Image save" nodes: got prompt Failed to validate prompt for output 29: * (prompt): - Failed to convert an input value to a INT value: quality, false, invalid literal for int() with base 10: 'false' * MathExpression|pysssss 224: - Return type mismatch between linked nodes: a, INT != INT,FLOAT,IMAGE,LATENT - Return type mismatch between linked nodes: b, INT != INT,FLOAT,IMAGE,LATENT - Return type mismatch between linked nodes: c, INT != INT,FLOAT,IMAGE,LATENT * Image Save 29: - Failed to convert an input value to a INT value: quality, false, invalid literal for int() with base 10: 'false' Output will be ignored Failed to validate prompt for output 26: Output will be ignored Failed to validate prompt for output 270: * (prompt): - Return type mismatch between linked nodes: a, INT != INT,FLOAT,IMAGE,LATENT - Return type mismatch between linked nodes: b, INT != INT,FLOAT,IMAGE,LATENT * MathExpression|pysssss 270: - Return type mismatch between linked nodes: a, INT != INT,FLOAT,IMAGE,LATENT - Return type mismatch between linked nodes: b, INT != INT,FLOAT,IMAGE,LATENT Output will be ignored Failed to validate prompt for output 224: * (prompt): - Return type mismatch between linked nodes: a, INT != INT,FLOAT,IMAGE,LATENT - Return type mismatch between linked nodes: b, INT != INT,FLOAT,IMAGE,LATENT - Return type mismatch between linked nodes: c, INT != INT,FLOAT,IMAGE,LATENT Output will be ignored Failed to validate prompt for output 250: Output will be ignored Failed to validate prompt for output 98: Output will be ignored Failed to validate prompt for output 229: Output will be ignored WARNING: file_padding.IS_CHANGED() got an unexpected keyword argument 'path'
how many graphic cards you need to be able to to this?
Mine is Nvidia GeForce 3060
i hope this technology fails. also, ain't nobody gonna believe that speedpaint 😭
exactly.. what happened to real art? now we just got ai doing the work for us.. not to mention, it doesnt have the spark of creativity anymore😭
dance do it
Is this video to video
It's not a case of video-to-video; rather, it's image-to-video utilizing Stable Video Diffusion (SVD).
wow
✏️
Can you send me the workflow for STEP3, because the video can't see which steps you used
3:06 you can see the workflow.
@@ThatClaireLee I've already set up step 3 with your video, thanks, I'm going to test the next steps now
So first I need to put in a video to extract continuous video frames, and then perform 4 operations, and the resulting picture is put into 5, and the picture from 5 is put into 6, right?
1. In Step 3, extract the DWPose frames and specify the output path in the '2) Input Openpose Directory group' (workflow for Step 4). This eliminates the need to extract continuous video frames separately. 2. Complete Step 4 to generate a raw dance video, then use it as the source video in Step 5 for additional refinement. If the video meets your expectations at Step 5, advancing to Step 6 is optional. If you choose to proceed to Step 6, use the refined video from Step 5 as the source.
new to these, can I only get the motion data if I have say a 3D model?
Hi only one question : how many Vram did it take? Because i have issue with 12 gb Vram
😂😂😂
Are there any discord servers ? I'm facing some bugs wondering if you could help
Can you share the workflow 😢 pls or tutorial
You can check this video, th-cam.com/video/kZ39YY0ONW4/w-d-xo.html.
完整版: th-cam.com/video/jMAERAX9-50/w-d-xo.html
❤❤jcfjn 😍😇👍
А что это токое
im reality
Below are the video links from Pexels that I used to create this video: 🟢Video by Darina Belonogova: www.pexels.com/video/woman-cleaning-messy-makeup-7214652/ 🟢Video by Darina Belonogova: www.pexels.com/video/woman-lying-on-bed-7214644/ 🟢Video by Darina Belonogova: www.pexels.com/video/stressed-woman-leaning-against-the-wall-8721775/ 🟢Video by Darina Belonogova: www.pexels.com/video/girl-putting-an-airpod-on-her-ear-8721772/ 🟢Video by Darina Belonogova: www.pexels.com/video/a-young-woman-riding-a-train-8721788/ 🟢Video by Darina Belonogova: www.pexels.com/video/young-woman-leaning-on-a-handrail-8721787/ 🟢Video by Darina Belonogova: www.pexels.com/video/a-woman-eating-while-sitting-on-the-bench-8721789/ 🟢Video by Darina Belonogova: www.pexels.com/video/woman-touching-her-curly-hair-7214689/ 🟢Video by Darina Belonogova: www.pexels.com/video/young-woman-running-away-8721780/
How did you do it plz explain
Hi, I created this video in three steps. First, I made an opening image using stable diffusion. Then, I used SadTalker to give the image a speaking effect. Finally, I used the Loopback Wave script with the same init image to put together the rest of the video. SadTalker: github.com/OpenTalker/SadTalker Loopback Wave: rentry.co/sd-loopback-wave
Below are the video links from Pexels that I used to create this video: 🟢 Video by Dhanus Samsen: www.pexels.com/video/woman-reading-a-book-1122524/ 🟢 Video by Pavel Danilyuk: www.pexels.com/video/girl-walking-between-red-poppy-flowers-4811927/ 🟢 Video by Claudio AFC: www.pexels.com/video/back-view-of-woman-walking-in-a-trail-5476886/ 🟢 Video by Anastasia Shuraeva: www.pexels.com/video/an-elderly-woman-walking-outdoors-with-trekking-poles-8794915 🟢 Video by MART PRODUCTION: www.pexels.com/video/a-woman-in-a-car-looking-on-a-map-she-s-holding-8865608/ 🟢 Video by Michael : www.pexels.com/video/driving-on-a-forest-road-4254119/ 🟢 Video by Anastasia Shuraeva: www.pexels.com/video/woman-driving-a-car-8033607/ 🟢 Video by Anastasia Shuraeva: www.pexels.com/video/woman-posing-while-looking-at-camera-8033614/ 🟢 Video by Alena Darmel: www.pexels.com/video/woman-walking-while-holding-papers-8141605/ 🟢 Video by Yan Krukau: www.pexels.com/video/people-getting-angry-at-a-coworker-7640072/ 🟢 Video by Karolina Grabowska: www.pexels.com/video/women-teasing-a-coworker-in-an-office-8547457/ 🟢 Video by Mikhail Nilov: www.pexels.com/video/couple-arguing-6963975/ 🟢 Video by cottonbro studio: www.pexels.com/video/a-woman-alone-in-a-bar-look-over-her-shoulder-on-people-dancing-in-group-3188957/ 🟢 Video by Ketut Subiyanto: www.pexels.com/video/portrait-of-a-smiling-woman-4587915/ 🟢 Video by Karolina Grabowska: www.pexels.com/video/a-woman-fanning-herself-with-money-5981203/ 🟢 Video by Diva Plavalaguna: www.pexels.com/video/tracking-shot-of-excited-people-6194825/ 🟢 Video by MART PRODUCTION: www.pexels.com/video/sad-woman-sitting-on-a-window-sill-7277946/ 🟢 Video by Anastasia Shuraeva: www.pexels.com/video/a-smiling-lady-posing-outdoors-8795164/ 🟢 Video by Tima Miroshnichenko: www.pexels.com/video/a-woman-training-her-boxing-skills-5751968/ 🟢 Video by Tima Miroshnichenko: www.pexels.com/video/woman-practicing-kick-boxing-on-punching-bag-5751983/ 🟢 Video by Los Muertos Crew: www.pexels.com/video/close-up-shot-of-a-man-practicing-his-punches-8810056/
Below are the video links from Pexels that I used to create this Deforum Hybrid video: 🟢Video by Taryn Elliott: www.pexels.com/video/a-woman-running-in-the-woods-7230815/ 🟢Video by tugay aydın: www.pexels.com/video/woman-running-inside-the-maze-6132157/ 🟢Video by tugay aydın: www.pexels.com/video/woman-walking-on-garden-6132156/ 🟢Video by Meszárcsek Gergely: www.pexels.com/video/front-view-of-legs-walking-5571830/ 🟢Video by Honye Sanges: www.pexels.com/video/beautiful-woman-running-towards-camera-in-slow-motion-5327147/ 🟢Video by Honye Sanges: www.pexels.com/video/woman-modeling-on-the-outdoors-5327149/ 🟢Video by Honye Sanges: www.pexels.com/video/a-beautiful-woman-standing-at-an-abandoned-railway-platform-5327178/
Whoa nice