ComfyUI: Perfect Lip-Sync & AI Face Animation! Bring Any Portrait to Life with AI Live Portrait

In this Workflow I Created Perfect Lip-Sync & AI Face Animation with the help of ComfyUI"Learn how to create perfect lip-sync and face animations using advanced AI tools in this step-by-step tutorial! In this video, we explore how to use ComfyUI, Mimic Motion, and Live Portrait to animate any face, syncing lips with audio for stunning results. Whether you're a beginner or an experienced creator, this guide will walk you through everything-from setting up the workflow to generating professional-quality AI portraits.
► For Daily | Workflows | News | Tutorial
► comfyuiblog.com/
In this tutorial you can create Text to video, Image to video, comfyui video generation
Featured Tools: Juggernaut Reborn SD1.5, Control Net, and more!
If you love tech, AI, and animation, this video is for you.
🎯 What You’ll Learn:
How to set up ComfyUI and install custom nodes
Uploading and using reference videos for precise lip-syncing
Applying the Juggernaut Reborn SD1.5 model for accurate face movements
Step-by-step guide to animating lips, eyes, and head poses with AI
👉 Don’t forget to like, subscribe, and hit the bell for more tutorials on AI-powered animation!"
comfyuiblog.co...
Credit civitai.com//m...
-----------------------
#comfyui #comfyuiworkflows

[@blizzforte284]

I get the error:
When loading the graph, the following node types were not found:
ReActorFaceSwap
Nodes that have failed to load will show as red on the graph.

[@gardentv7833]

great, thank you, let me know when you revise the workflow to syn audio and lips. by the way its a very nice workflow. thanks for your effort. Have a nice day SIR !!!

[@ComfyUIworkflows]

Will updated

[@HùngPhạmVănMạnh]

Audio syncing is the only issue, can you update it as soon as possible?

[@ComfyUIworkflows]

sure we will

[@user-fo9ce3hr5h]

hi, do you know any model for comfy ui so we can create ai avatar speaker?
i am searching for a comfy ui model that i give him a photo (my avatar) and a voice file , then comfy ui give me ai avatar speaker with lip+eye+face synce.
i know there are websites to do it but i want to make it in my local pc for free. i have pretty good gpu.

[@ComfyUIworkflows]

we will make workflow on that

[@anuarseitkan3118]

Where should we load the image of the girl? I mean the original photo to which this manipulations will be applied

[@ComfyUIworkflows]

Hey, there's no need to load an image. If you want to do that, we'll need to create a new workflow. But when you run this, it will automatically generate a portrait of a girl, which you can use.

[@masteringodoo]

Is the lip sync not correct in the original video yhat you wre using ? I mean with respect to the qudio track. I ask because your output is out of sync with audio.

[@ComfyUIworkflows]

due to during editing process.. but we will improve this in future we are yet 100%perfect, but we are trying to get a best result

[@godwinspeaks]

​@@ComfyUIworkflows The workflow needs to be fixed to correctly render the audio in sync with the video.

[@anuarseitkan3118]

Where can we find workflow, can u share it?

[@ComfyUIworkflows]

comfyuiblog.com/wp-content/uploads/2024/09/live-portrait.json

[@anuarseitkan3118]

@@ComfyUIworkflows Thank u bro, u did a great job! But I have problems with ReActorFaceSwap node, don't u know where can be the problem? I just want to use your workflow

[@godwinspeaks]

I tried your workflow. Nice with so many detailed steps. But, I don't understand the purpose of all this planning for the workflow when the output video has audio without sync. It's not at all matching the lip movement. That's the only major issue but the workflow details is nice.

[@ComfyUIworkflows]

if the result is not has per expectation we will try and update this workflow, what we can do now

[@godwinspeaks]

@@ComfyUIworkflows Can you make it lip sync with the audio input? The lips move but its not syncing perfectly. When I used a simpler workflow with Instant ID, it syncs but I dont have so much control like your workflow. Your workflows process is perfect by using a combination of Instant ID , Animatediff,mimicmotion and others but the audio syncing is the only issue. If you can fix that, it will be really great 🙏🙏

[@kfrfansub]

the lip is not synchro in your output

[@ComfyUIworkflows]

due to during editing process.. but we will improve this in future we are yet 100%perfect, but we are trying to get a best result

[@GerrMorales]

it looks very artificial

[@ComfyUIworkflows]

if the result is not has per expectation we will try and update this workflow, what we can do now

[@deandresnago2796]

Well artifical stuff usually dose ?