ไม่สามารถเล่นวิดีโอนี้
ขออภัยในความไม่สะดวก
Lip Syncing Has Never Been Easier | PIka AI Video Tutorial
ฝัง
- เผยแพร่เมื่อ 7 ส.ค. 2024
- In this video, I'll show you how to sync lip movements on AI videos directly inside Pika Labs.
Download the Assets: www.dropbox.com/scl/fo/wadktq...
Explore AI Filmmaking: curiousrefuge.com/ai-filmmaking
Check Out Topaz Video AI: topazlabs.com/ref/2155/
![CAMPปลิ้น | EP.79[1/2] แก๊งไทบ้านพาบุกเมืองบั้งไฟโก้ ยโสธรรรร!!!](http://i.ytimg.com/vi/Ldr3_fvTEXk/mqdefault.jpg)
Opening video skit was awesome! Great job!
haha thanks dude.
Love it when your videos pop up. Always really helpful!
Glad you like them! Thanks so much for watching!
Thanks for the video. It's amazing and solved every requirement that I had at this moment. I tried out so many things but nothing worked out so far as per my satisfaction. Now, with Pika and other tools, a perfect (at least close to perfect) talking head video is made that blinks her eyes. It's a bit robotic at the moment, but definitely it's working. Thanks a lot.
You're welcome!
Awesome info I can actually do a music video with lyrics now! Subscribed!
That's true! Thanks for subbing!
Thanks for another excellent video.
Our pleasure!
Thank you. This is the information I was looking for
Glad it was helpful!
Nice to finally having something accessible that isn't the headbob generator, lol. RIP D-ID.
This will help keep moving everyone forward :)
great tip with the topaz fix!!! boom🙏
Glad you liked it!!
Amazing channel! So well done! IS there a way to have the the characters eyes blink will speaking even once, and what to do to correct if lips seems off when speaking? Thank you for this awesome channel! Cheers!
I'm excited for class to start AI Advertising!
Woo hoo! Excited to have you in the course. :)
Oh that's fantastic news! :) I'm sure it will get better.
It's only the beginning :)
How far technology has come! The guy who reads the text looks real!
Haha you mean Caleb???
@@curiousrefuge I have no idea what the name of this character is, in a circle, reading the text.
Wow, this is very nice! : )
Thank you for watching - cheers!
Excellent tutorial thank you
We appreciate you! Thanks for watching :)
Dude when did pika dropped this gem?? I guess time to renew my credits..thanks for the tip!
Less than 24 hours ago :)
Was going to try it and it said I can't. It only works with the pro plan? $58/month is the cheapest plan where you can use this?
True it's pretty pricy - and currently only with the pro plan.
Now available for everyone. I have a pro license though but can’t see how to create longer lip sync than 3 sec, it’s automatically trimming video and audio to max 3 sec..
@@IvoKlerk Weird, I did notice that when you look at the plans now, every single paid plan has the lipsync functionality now... But none of them mention anything of time limits. Did you figure it out? Was it an actual limitation of 3 seconds on every plan or was it something on your end? I'm guessing it's capable of longer based on the demos in this video we're commenting under! Let me know if you figured it out. Thanks!
@@IvoKlerk Actually in this tutorial he mentions it's 3 seconds limit if you use a still image. I think if you use a video, you can go longer. I'm going to try it.
Awesome. It's about time!
Indeed!
awesome!
Thank you! Cheers!
Very helpful and informative video. Thanks for posting! A few questions: Do the paid versions improve the lip-sync quality? I noticed that on some syllables the mouth opens far wider than with others. Also, does the program automatically add a teeth image? On my Pika test production, I used a video created in another program (CrazyTalk) that inserts "teeth" to appear when the mouth is open. In the The Pika test video I created, it appears as if Pika does the same, because on playback the inside of the mouth appears a bit odd.
We'll do some more testing and get back to you. There may have been a few more updates since then! We appreciate you watching and engaging!
oh man. it begins.
::cue the Terminator 2 music::
Thank you for this video. It was very informative. I just subscribed to Pika but I haven't been able to add the 4-seconds option. Do you have a video that explains that?
Glad it helped! Yes, you have to extend the scene (one of the buttons). Is that button not showing up for you?
@@curiousrefuge Thank you for responding so quickly. I have the button it does show up and I click it, but nothing happens it never extends it. I think I must be missing a step or something but I don't know what it is.
Before I try, do you think it will work if I change the image every 1 second in a video or must the video only have like the same scene/character the whole time so it wont glitch out?
Sorry I'm unsure of your question - mind rephrasing?
thanks a lot!
Our pleasure!
I feel its a half hearted attempt from PIKA. Lot of bugs and the quality isn't comparable with HeyGen or DID at all. Lalamu did a better job in my view. The competition is getting tougher by the day. They need to level up else SORA will take the cake
Fair perspective. There is still a lot of work to be done on all sides but we think this is also a big gain for workflows (not explorting with back and forths - at least for Pika users).
Pika sucks … worst paid AI experience I’ve had. Was fun at first but they clearly aren’t progressing anywhere near as fast as others
@@Jam_Bonwhat do you recommend to turn ideas into short videos with ability to lip sync? I am looking to get going on some projects but havent nailed down a clear winner yet (thats available). Thank you
first , thank you for the video
Our pleasure! Thanks for watching!
THank you very much
Our pleasure!
main issue for is that the video quality just inst there yet. more so with landscapes it just makes it very muddy even when upscalling . i hope in the future pika really tries to work on upgrading their video quality. but not a bad start with the lipsink
We'd also love that!
very cool
We're pumped!
Thanks for the input. Through you I found out that Pika supports Lip Sync.
I take this opportunity to ask you if you know how to improve contact eye. I did a simple test with "Descript" and a single minute took hours to process.
So glad you enjoyed the contact! We'll have to test some ways and get back to you!
well i hope eventually i can afford 70$ a month to do this. this was a pretty kick ass upgrade!!
Definitely a cool upgrade!
I was trying Pika Labs to lip-sync with a FREE tier. It takes forever and shows me the "File size should be less than 10MB" error. Do I need a paid plan for files bigger than 10MB? Thanks in advance.
For more than 10MB we believe you do...
Interpretation of scripts complete with director's notes will probably be coming soon.
Ahh good point! We'll see...
I must ask, where did you get the jacket, i want it too!
We'll have to start a Caleb Ward'drobe section of the videos :)
But really where did you buy it? Can you ask him?
Is it possible to make a video of myself and then add music that I wrote And recorded to create a lip sync Video.
Yes it is possible!
Awesome
thanks for watching!
Hello, thank you for your good videos.
I want to start a TH-cam channel and make an anime on the subject of the first discoveries or ancient inventions of mankind, such as the discovery of fire, chips, oil, popcorn, etc.
Is this possible with a mobile phone?
How should I write my prompts that include many sequences and provide the details I want correctly? Thank you for your guidance❤
It is possible because many of these apps are web based. HOWEVER, it will be difficult. You can try the runway app to use mobile tools for video, and midjourney on discord can generate images. Then use any mobile editor. However this will be a lot of thumb moving! :)
can you change the teeth? say you wanted yellow and sharp teeth
You can try inpainting and see what you can get. Also photoshop generative fill may help!
Just to note, this feature is for Pro and Super collaborators only for now*
True! Thanks for adding that clarification!
how do you get them to talk ?
Add your own audio file :)
@@curiousrefuge i saw this is cool but very expensive atm so i will wait till hopefully i get monitized
As I understand, there is no way to lip-sync with a specific voice (or the voice from uploaded video?). To kind or remix of what one is saying
You can choice voices from an ElevenLabs API (a handful of options) or you can upload your own MP3 file!
@@curiousrefuge but then lip syncing will happen to whatever is IN that audio - not by taking that audio and WRITING whatever you want the lips to say?
Pika das galáxias
We
This is my first attempt at AI. th-cam.com/video/5HpmF80aApQ/w-d-xo.htmlsi=FVxRu5bIWGoCh28V
Let me know what you think.
We'll check it out soon!
Anxious to try this, my last lip sync project used HeyGen, and it came out pretty good, but they get pricey
Very true - these tools can really start to add up!
does this work on animals like a cat?
Unfortunately not well but with some testing it does!
7:02 LOL, talking over her "other mouth"
Haha there are still some things that need to be worked out :)
nice:)
Thanks 😁
really awesome. i can't wait til the market is flooded by the end of the year and maybe then they lower those absolute decapitating prices. $30 bucks per month x 10 different ai tools, that is too much money. I saw midjourney estimated sub count has dropped significantly, they should be the first to lower the price.
True - all these tools are really starting to add up!
Has anyone tried Lalamu yet? Its also pretty amazing
Lalamu is another great tool!
@@curiousrefuge I tried it a few times. It might be even better than pika and is free to use now. After upscaling the videos its useable
cool! would be nice if they allow one free generation , they ask to pay for lip sync while not sure how it will turn out
That's a great idea - we hope they do that too!
Wow topaz doesn’t even have a free edition $300 for video? Also how are you getting 8 second clips from pika labs?
Topaz is pricey BUT it's a one-time purchase which we highly recommend. For Pika - you can extend scenes an additional 4 seconds!
Passed years still mostly talking avatar using same wav2lip integration, no improvement after wav2lip or new method for lipsync ,
We believe there is a strong advancement in terms of the blur box that typically comes with Wav2Lip.
where is the link?
For Pika labs?
Ok guys, help a noob out. At 1:43 he shows this lovely interface where you add things, change settings, do camera stuff, etc....discord messaging does not look like that. As far as I can tell, the internet is telling me that the way to use pika labs is to message the Pika bot in discord (I joined the discord already). But discord direct messaging does not have those options or look like that interface he is using! And unfortunately, there is no link to pika labs in the description as he promised, so I still can't find any pika labs site that I may be missing. Could you guys help a girl out?
For questions like this, feel free to jump into our Curios Refuge discord and we can help answer this questions!
@@curiousrefuge Perhaps I'm just not familiar with Discord enough, but I searched for curious refuge and curiousrefuge on discord and I didn't see any results. How should I join the discord?
Add a Song maybe?
Good idea! We will next time :)
*It says its only avalible to Pro memebers which is £600 a year. WTF dude.*
True! It's a super steep cost at this time. We hope this goes down as the competition rises.
You a bit slow... have you not seen EMO : text to image. Its on another level 😮😮😮
What tool are you referring to? Mind sending a link?
28.00/usd a month is overpriced at this moment in time for this. will wait for a better alternative...with the way AI improves it shouldn't take long
Fair point!
Yeah, but right now just available for Pro users :(
True! It's quite new so hopefully it opens up int he future. We'll see!
pika labs... 1080 max.... no 4k..... sludgy visuals... more miss than hit on prompts
We appreciate you engaging and watching!
I used to think Pika was impressive. But now that I've seen Sora, all other AI videos look really rough. The Pika lip syncing might be "easy" to create, but the results are not really usable. The distortions and artifacts are so distracting that you can't focus on anything besides that. I'm sure in 6 months, Pika or another company will have refined Image to Video so it doesn't look so clunky.
We'll see how it all evolves in the next 6 months. We appreciate your perspective!
@@curiousrefuge apparently, we didn't need to wait 6 months for the lip syncing to be drastically improved. lol: th-cam.com/video/wtcSZdHZne4/w-d-xo.htmlsi=FwrxN7LNPnhgmXxP
they limit it to 3 second clips, lame
Much lower quality than what Sora is bringing in just a few months.
We'll see what Sora will do about voice syncing...time will tell!
it looks absolutely hideous but a start
Over a few months there should be some great improvements :)
EMO is coming.
We look forward to it!
honestly it just looks like shit...
i generate ai pictures in mass and my videos are not animated but before i animate such a shit i rather leave it and make only beautiful pictures
We appreciate you enganging with us. These tools keep getting better and better.
looks like shit , good enough for memes though
Fair enough, but it's only the beginning!
So long winded
We appreciate you watching!