ฝัง
- เผยแพร่เมื่อ 2 ก.ค. 2024
- In this video I show how you can use Papagayo to help you setup lip sync for your characters and then how to import it in OpenToonz. To do that, involves the following steps:
Papagayo:
00:00 Intro
00:47 Install and run Papagayo
01:48 Load audio file
03:36 Paste in script text
04:30 Adjust sentences
06:29 Adjust words
07:21 Adjust phonemes
12:21 Export data file
OpenToonz:
13:25 Adding the audio file, reviewing the 10 mouth shapes & getting OT ready for import
13:52 Apply lip sync data file
15:48 Final Adjustments
Setting this up to show as clearly as I could took me a few hours, so I did some strong editing to make the video as succinct as I could. Hence, lots of sped up video. I hope you can still follow this ok.
Download from: papagayo.software.informer.co...
--------------------------------------------------------------
If you liked what you saw and want to help out, you can buy me a coffee or a Darren Tea ;-)
www.buymeacoffee.com/DarrenT
Check out useful OpenToonz-companion software you can download or purchase:
gumroad.com/DarrenTAnims
The kit I use and recommendations of useful books:
kit.co/DarrenT
--------------------------------------------------------------
Discord: / discord
For help setting up and using OpenToonz, chat with animators & developers and enter animation challenges.
Twitter: / darrentanims
Facebook: DarrenTAnims
Twitch: / darrentanims
More about me: / darrentanims
outro music courtesy of Voltaire: / voltairemusicpage - ภาพยนตร์และแอนิเมชัน
*Thanks for watching.* Timecodes for skipping through the video and download links are in the description
*All my OpenToonz tutorials:* th-cam.com/video/saDNGVj46Xc/w-d-xo.html
For help setting up and using OpenToonz, chat with animators & developers and enter animation challenges, join my OpenToonz Discord: discord.gg/FYy4Mg7
9:05 I was going crazy since I couldn't find this option, thank you
Glad it helped 😀👍
Thank You SOOOOO Much! My dreams of becoming an animator can finally come true! I just made my first lip-synced animation!
That's great news Aharnish. Congratulations :-)
my fream too, bt have to kill that dream....due to some reasons
duuuude, u are my animation university, opentoonz and free software are the loan!
I'm glad you're finding the vids useful, my friend :-)
This guy is still providing tech support in the comments, Give it up for this champ.😁👍❤💖
Your videos have such high quality, and you have good content. This is the best and most detailed tutorial i found, thank you! And i also subscribed!
Thank you Joseph. I'm pleased it helped. And welcome to the team 🙂.
And I hope you can join me for my live stream in just over 2 hours
@@DarrenTAnims Ok! I will!
Good job, I have that book as well. I also used it for my animation basic classes I taught back in 2004 - 2006.
It's a great book. You can't beat having an actual book in your hand to look through. Or maybe I'm just old fashioned. 😁
Thank you very much! It really helped me in my video. May god bless you
Thank you my friend 🙂
Oh wow cool, wasn't sure if papagayo was compatible with open toons. Such a lengthy process but usually worth it, of course depending on rendering as in my experience there is a frame rate issue if you render as frames then apply a better audio. Switched over from harmony and loving this so much better. Great video dude!
Thanks Ryan. I suspect that the process might seem lengthier than it is purely because you're watching an explanation. Performing the lip sync setup yourself, once you get used to the flow, doesn't take too long. And for me, I find it quicker than manually doing so in OpenToonz.
@@DarrenTAnims hey thanks for the reply! Yeah I used a fair bit in synfig. And papagayo was a charm. I could only use wav format and that wasn't enough in terms of audio quality, so I had to render everything into frames and process into a video in another editing software. Hoping they allow mp3. Anyway I subscribed! And thanks again!
Good job! well done!
Thank you
u got a like and a suscriber man
Cheers Kiddo 😉👍
Thank you Darren. Does anyone know a way or tool, which can use more than one frame for each mouth shape?
I would like to have a more smooth transition between the different phonemes, without doing it all manually in OT.
Thanks for any tips!
The auto tools all work on 10 mouth shapes. But there's no reason why you can't manually add in your inbetween shapes after you've run the tools. That's what I'd do.
I wonder if running the shapes through Papagayo is much quicker than scrubbing and going through opentoonz directly. One thing it does offer though is the data file, which can be useful if you have to recreate the scene, so it is probably still worth it in the end! Looking forward to more.
Its better to use both to make it as timely and accurate as possible.
That's a great thought Penguin. Scrubbing to add lip sync isn't that difficult. But using Papagayo adds 2 benefits.
1. The basic mouth shapes are already defined for you once you add your script.
2. I find seeing the waveform a little easier to see in Papa than in OT.
But, that being said, I plan to add some lip sync directly in OT in the coming weeks, as a fun exercise.
Absolutely. There's always some manual fiddling needed afterwards. I'll be using this output next week to add the actual lip sync to the animation.
Great lesson Darren, I was also confused why with the two versions one doesn't have export or add new voices option etc,
Also it would be good if they (Papagayo developers) had a sensitivity dial to adjust for silence = close mouth, because the way it doesnt always match automatically makes long passages of audio very time consuming to manually tweak. It would be good if like a noise gate/detector would be adjustable and then silence would always have the mouth closed which is very important imo and the other mismatches of sylables shapes can be less significant
That would be really helpful, yes.
I've not used Papagayo for a while. I've been using the built in auto lip sync tool since it became available.
@@DarrenTAnims Oh ok i will check that out, thanks for your great lessons and info,
I've already got a lesson about this on my channel, in the lip sync section. And I'm putting another together atm about using the auto lip sync as a reference to hand draw each mouth.
@@DarrenTAnims Great, ill watch it now, thanks a lot Darren !
Hi Sir!
If i will import my animation in a regular film project, 30fps. Do you recoomend 24fps in Toons?
I think I would try both 24fps and 30fps in 2 different scenes, to see which works best. I think I'd probably prefer to use 24fps and same the speed of the film to match.
version 2.1 beta is not available today and when I tried to download verson 1 it refused. I am looking for an alternative program. Neither would they allow access to the home page.
Oh dear. I'll take a look into this. In the meantime, I'd suggest googling for a download for it. There is probably another site with it on.
help Darren I still can't decide if it's better to auto lip-sync or manual lip-sync I heard correcting the auto lip-sync takes as much time to do manual lip syncing what should I do?
Using Papagayo can take a while, but it can sometimes give you a better result. But the best thing to do, as with many things in OpenToonz, is to just try it for yourself, to see which you find easier. Different users have different needs and different abilities. Some find manually adding lip sync quite easy.
@@DarrenTAnims ok
Hi Darren... thanks for the great content I've learned a lot quickly by watching your tutorials. I'm having a problem I hope you can help solve. I have my character designed into different layers in krita. I safe each individual as a png and import my "puppet" into opentoonz. However I can't seem to import each mouth shape on the same level/column? I attempt to use drawing tab and each import creates a new column and doesn't allow a new drawing insert. What am I missing so I can make a singular column for all mouth shapes? Thanks in advance.
Hi. Your drawings will only load as an image sequence (in a single column) if they are named as OpenToonz expects: i.e. Name.number.extension.
Example: Mouth.0001.png and Mouth.0002.png
Also, if you save your Krita drawing as an .ora file. This is actually a zip file. So if you rename it to a .zip and then unzip it, you'll find a png image for each layer. I thought I'd mention this in case it's useful to you.
Thank you so very much.... this really clears this up for me.... hopefully I'll have luck applying it to my project. 👍
@@DarrenTAnims Worked like a charm.... thanks so much. Any advice on how to run Rhubarb on a Linux mint 20 OS?
Much thanks
That's great to hear.
I've never run Linux, so can't really help there. Sorry.
Sir how to import image in a collomn but in different level. Means I want to import different mouth shapes wich I drawn on inkscape. So how can I import them in one collom but different level for Lio sync help me sir
You have to name each image as part of an image sequence. One way to find out what the image sequence filenames should be is to render out a few frames from OpenToonz as a PNG or other image format. You'll see the naming convention that you need. (Handy for the future when you forget, as we all do)
But the naming needs to be in this format (use any text instead of "mouth"):
mouth.0001.png
mouth.0002.png
mouth.0003.png
etc
I’ve hit a road block. The unedited dat file from papagayo will populate on xsheet when I apply lip sync data to column. But when I edit it and clean it up in papagayo and save it the same way, it does not populate in the xsheet at all, nothing.
Maybe you should clean it up more in OpenToonz, if the edited version is causing a problem. I don't know why you have this problem though, sorry.
@@DarrenTAnims you know what. I think it had trouble processing a larger clip. I processed one half at a time and that seemed to do the trick. Thank you sir. Check out what I’ve just made on my channel. Took me some time but it was a lot of fun
And how can I edit Voice? to act different characters and .what papageya does?
Are you referring to editing the sound of your voice? If so, then the more you can change your voice yourself before you record, then better. And there are small changes you can make in your audio file editor, to make your voice higher or lower pitched.
Hello DarrenT! What is your microphone s brand?
Hi. It's a Neewer. I bought it simply because it was USB, came with an arm and was one of the cheapest, but I'm really happy with it. You can see a link to it on my kit page: kit.co/DarrenT
Thanks! The value for money of this microphone is so good! Oo
Thank you. I'm glad that comes across. I'm very happy with it.
What could be a reason why the last step - "Apply lip sync" doesn't do anything? Everything works up to that point. I've tried both .jpeg and .png. It worked a few moths ago and now even if I use those same old files nothing happens, except the whole column gets filled with empty cells, overwriting the 10 shapes, keeping a random 1 or 2 shapes.
The usual reason is when you have individual drawings and not a sequence of drawings.
If you draw them all in the same level in OpenToonz, it should work.
If you've drawn your mouth shapes externally and dragged the drawings into OpenToonz, you need to ensure they're named as an image sequence: image.0001.png, image.0002.png, etc
@@DarrenTAnims Thank you, what you are saying helps and it is working now. Nonetheless, I can't really say I understand the process. I renamed the drawings to ""0001" "0002" and it it didn't work. Only "mouth0001" did. Not sure why. (Drawing 10 shapes in Level strip doesn't do anything either). Then, when loading through Browser there was only 1 line to load, but "10 frames". This, I suppose, is what you are referring to as a sequence of drawings, but I don't know how the program discerns this as a sequence instead of separate drawings - just by file names, I guess? And I'm pretty sure I used to load drawings named "AI", "U", "etc".... before.
@@egonpauli145 For the lip sync to recognise the sequence, you can't use ai.png, etc. They need to be named as a sequence. And they can't just be numbers. You have to have text, then a dot, then a 4 digit number.
Hi Darren! Hopefully you can help me...
Somehow I always get the message: "Unable to apply lip sync data to this column type."
What am I doing wrong?
Make sure that you've selected a drawing in a column and that the drawing is part of a level with at least 10 drawings in. That's the only time I've seen that.
Good luck. Let me know how it goes.
@@DarrenTAnims Sadly it still doesn't work. I'm on the right column with the 10 mouth shapes. Any other idea 💡?
Maybe it's the wrong file type? I've saved all 10 mouths as png, imported them to OT and put them all in one column. They're now single raster images.
I've converted them to vectors. It seems to work with that file type but I now each picture is seperated in their own columns. I can't just put them together because then the other drawing get's replaced by the old one. Do you know the solution for this problem? 😊
It won't work with individual images. They have to be part of a level. If you've drawn them as png images, then they just need labelling as an image sequence (name.number.ext) e.g. mouth.0001.png.
And I'm guessing that you converted the images to a vector level, 1 drawing at a time, so you've created 10 vector levels, all with 1 image. But if you want to, you can copy the vector images into the same level. Or start again.
@@DarrenTAnims
I've got it!! 😊 Thanks a lot!!
i had a hard time trying to make it work. it still does not work. if i sync a first voice and create a second one, i cant even go back to the first one. maybe i installed a wrong version but im confused of all this causalitys and can not even start working with it. but it looks cool how your workflow goes.
That's strange. Did you download from the link in the description? Changing the voice in the drop down should work.
Also, I've been told this week about a new version of Papagayo that you might like. I hope to have a video out about it soon.
@@DarrenTAnims cool, the bell is activated! I would send u a pic on discord but i already deinstalled.
@@Dramastag_Theater if you reinstall and have good issues, let me know. But keep your eyes open for details of the next version 🙂
Hi Darren, is Papagayo available for Mac?
Yes. If you go to the website, you'll see the mac download too.
However, the latest version of OpenToonz has built in support for Rhubarb auto-lip sync. It might be worth trying that out first.
14:12 I'm on this menu and It's only showing me one mouth option for every section.
That'll be because you've not selected a drawing that's part of a drawing level or image sequence. Every time that some has this issue it's because they've imported their mouth shapes as separate images and not as part of an image sequence. If this could be you, then check out my video about image sequences; specifically the naming of them.
When I import some wav files the wavelength won't display itself. Does anyone have any solutions for me?
Is this when you import to OpenToonz or Papagayo?
@@DarrenTAnims I think I've found the issue. Papagayo dosen't seem to like files with punctuation. Files with a "can't" just need to be changed to a "cant" and it seems to work.
what if the audio is longer than the lip sync
That's fine. Papagayo will just place your mouth shapes where you requested and you can add any other animation around the rest of the audio.
Why doesn't the Selection Tool work on all levels in Opentoonz 1.5 ?
It does. Which levels is it not working on for you?
However, if recommend upgrading to OpenToonz 1.6 as soon as you can - take a nightly build for the most stable version.
@@DarrenTAnims Thank You
do you know how we can import it as a video just from papagayo?
You can't import it from the program, but if you wanted to, you could screen record it, then import that recording, but I'm not sure how that could help. Having the data file gives you an accurate representation of the sync that you've worked out.
@@DarrenTAnims alrighty thank you a bunch :D
Will it work even if I have a different language?
Yes it should. OpenToonz works with different languages and this should too. Download it and give it a try 🙂 You don't install anything, so you could just delete it or doesn't work for you.
if i apply lip sync data to column why is nothing happening
The number 1 reason is that you've not got a drawing from a level in there that has 10 different drawings. In the lip sync dialog you map the drawings to the 10 mouth shapes. And they must be from the same level.
Does not work. I did like until 15:00 (''Apply'' after choosen the .dat-File), but the Mouth-Shape-Layer did not change. I wonder how it would - how should OT know the connection between Layers?!
I got 10 mouthshapes in a COLUMN* (named mouth_01.png, mouth_02.png, ...)... [*NOT in a row, sorry]
I tried out another .dat-File - worked! But, there is no difference between the two files (except the order of the tokens)!!!???
The lip sync only works with a single level. If you've got 10 separate imported png images, then it won't work. Unless you name them as an image sequence.
@@DarrenTAnims I did. It is about the .dat-file. Another two files work as intended. I do not understand - maybe it is the name of the file? --> --> ->
01_Optimist.dat --> does not work. 02_Mr._Wiggy.dat --> works. 03_Optimist.dat --> works.
@@Tandorf - The filename could be it. I know OpenToonz has a problem with loading images with numbers and either a dot or underscore in the name. It tries to load them as image sequences. So maybe it's the same here. Just try them without the underscore or number.
But at least you've got it working :-)
@@DarrenTAnims Thank you! I will try.
Can we use this Papagayo in Tahoma2d?
You can if you want to, but since both Tahoma and OpenToonz now have Rhubard lip sync (with everything built into Tahoma) I don't tend to recommend using it anymore.
I follow this tutorial, but it didn't work. All it did was had level 1 change to 10 and had the rest stay as they are.
Have you tried with different audio?
And your 10 drawings are definitely in the same level? You can see them all in the level strip if you select one in the timelne?
@@DarrenTAnims I didn't tried different audio. I tried the one was already came with papagayo, which is Mojo Jojo's line and his line is in lame.wav. although the drawings are definitely in the same level.
@@Rover259Wild It's probably worth taking a look at the data file that Papagayo generates. Does that contain more mouth shapes or does that only have mouth shape number 1?
I've not used Papagayo for a while as I only use the built-in Rhubarb lip sync feature. It could be that something's broken in Papagayo or in the import to OpenToonz.
@@DarrenTAnims any of them.
Why am I unable to load Data File into Opentoonz
I've no idea. Do you see any messages that give you a clue? Are you loading it from the lip sync dialog?
As time's gone by, I tend not to use Papagayo, but instead use the auto-lip sync feature that's now built into both OpenToonz and Tahoma2D.
Tolong buatkan video tutorial menambah bahasa dipapagayo biar tidak bahasa inggris saja🙏🏻
Sayangnya, menurut saya Papagayo tidak dapat digunakan dengan bahasa lain, jadi Anda mungkin tidak dapat menggunakannya.
Namun, saya cenderung tidak merekomendasikan Papagayo akhir-akhir ini. Saya cenderung menggunakan sinkronisasi bibir Rhubarb bawaan. Detailnya di sini: th-cam.com/video/itib-Vt9nkI/w-d-xo.htmlsi=bIHzScTBv3-JQqeW
---
Q. Please make a video tutorial to add the language in Papagayo so it's not just English
A. Sadly, I don't think Papagayo works with other languages, so you might not be able to use it.
However, I don't tend to recommend Papagayo these days. I tend to use the built in Rhubarb lip sync. Details here: th-cam.com/video/itib-Vt9nkI/w-d-xo.htmlsi=bIHzScTBv3-JQqeW