edit 1 frame and let ebsynth do the rest - advanced ebsynth tutorial
ฝัง
- เผยแพร่เมื่อ 2 มิ.ย. 2024
- ☕ if you're up to it, you can send me a tip to help support my coffee addiction on kofi
☕ ko-fi.com/academyofedits
EBSynth is an incredibly powerful (and free) tool created by Secret Weapons that all editors need to know about. It essentially gives you the ability to edit 1 frame of a video and then ebsynth does the rest of the work by trying to apply that edit across the whole video! It's really impressive. In this video I go over some of the stuff you can do with ebsynth like de-aging someone, replacing background objects, and changing face expressions! I also go over some of the ebsynth advanced settings ( the mapping, deflicker, and diversity ) and explain what they do the best I can.
You can grab ebsynth from their website right here: ebsynth.com/
and if you want to read up more, the paper made by the creators is right here: dcgi.fel.cvut.cz/home/sykorad...
As the paper goes on to explain, contrary to what other tutorial makers say, ebsynth is not an AI video editor or anything like that, simply put ebsynth works by analyzing each frame and creating guides based on the data it can see, then using those guides as reference it tries to figure out how the pixels are moving from one frame to another. As much as I'd love to title the video something like EBSynth AI Animates your Videos for You! .... I'd be lying haha. I mean, I'm already stretching the truth a little but with this title because its going to be rare that you'll just be using the ebsynth output straight up as the final product so "let ebsynth do the rest" isn't strictly honest... as I go over in the video, ebsynth will mostly get you 80% of the way there really quickly and then it's our job to do that last 20% and get it across the finish line by compositing it in After Effects
my microphone
amzn.to/3BllGfV (affiliate link)
socials
/ academyofedits
/ theacademyofedits
timestamps
0:00 - intro
0:35 - example 1 - fancy bowties + advanced settings
5:26 - example 2 - sulky potter (changing expressions)
6:21 - example 3 - less ancient slughorn (de-aging)
9:52 - subscribe or have 2 weeks of bad luck
tags
ebsynth, ebsynth tutorial, how to use ebsynth, ebsynth animation, ebsynth how to, ebsynth faceapp, ebsynth with after effects, ebsynth examples, after effects, artificial intelligence, style transfer, ai animation, ebsynth beta, ebsynth keyframe tutorial
*Important Explanation for the Advanced Settings from the EbSynth Team*
I reached out to Secret Weapons (creators of EbSynth) and they were awesome enough to give a thorough reply/breakdown of what the *Mapping* and *Diversity* settings do so please ignore my guess in the video. Here is their explanation:
*Mapping* -- It's not really a defense against moving lights or shadows. If you wanted to suppress the artifacts caused by moving shadows, you'd have to use a video with a high-pass filter on it as a source instead of the classic RGB input. Mapping is more of a defense against similar colors on different objects in one scene. If your hat and your pants had the same color in the source video, EbSynth might think they're the same thing and use the texture from the pants on the hat too. The higher the mapping the more position-aware the texture is and even if the colors of several objects are similar, EbSynth knows that they are in different positions in the image and will associate them with the correct texture.
*Diversity* -- To understand diversity, it is important to keep in mind how EbSynth works. It breaks the painted keyframe into little pieces, like a puzzle, and reassembles those pieces to build a new frame. However, it might use the same piece over and over again and you might see some ugly repetitions in the results. Similar to the clone stamp artifacts in Photoshop. So the diversity tells EbSynth how many times it is allowed to use a certain piece of the texture. On low diversity, EbSynth is kind of free and can repeat each piece more. That might be beneficial for some cases. On higher diversity, EbSynth is bound and it has a limited number of repetitions to make. The thing is that EbSynth never warps any colors to match the underlying frame. It always only works with patches of pixels from the painted keyframe. That way the artist has more control over the results unlike with many current neural-network approaches.
So there you have it! Thank you Šárka for the awesome explanation of these two advanced settings :)
No problem! Thank you so much for this absolutely fantastic tutorial!
(also, I'm quite fangirling over the fact that you did the tests on Harry Potter scenes :D)
Thank you for this wonderful clarification! :)
Worth watching...
Raspek for the update
I'm glad you added this. Tutorials should never include the phrase "I'm guessing". (just have a look around the web at people doing "Compound Blur" tutorials... just... wow!). BTW, to better blend interim key frames where you have had to update the overlay mid shot, you can not only let EbS run forwards but also run it backwards to lay in the tweak in the reverse direction on top of your previous changes. Think of it as getting closer to perfect with each iteration, and EbS having a more perfect section to remap onto.
i'm thoroughly convinced this program runs solely on magic
sameee💀
scout holy shit
tbh
Yoww
well how do you define magic?
Using it to Luma matte is a big brain play
I whispered “oh shit” to myself when I thought to try it lol
Sorry, Im extremely interested in learning why it is a big brain play (Am currently learning AE)
@RudyR basically means using ebsynth to rotoscope
couldn't he have just flattened the photoshop layers into a smart object and then cut out his head in photoshop and just apply it to the footage through Ebsynth as just his head instead of the entire frame?
@@ThePieGuy731 yeah that's what i thought as well
Here I am spending the whole video dreaming about when I'll be able to afford this crazy program, and then the last line is "it's insane that it's free". So awesome
Not only is it free as in gratis, it's also open source!
Honestly if you were to ask me what was faked, I'd point out the row of kids standing behind each other before even realizing the ties were gone
The quality of this channel is ridiculous. You're amazing dude, thanks for the video!
Seeing how people are using this program is insane. I love the creativity
I have been using it for some months to create a music video that consists of scenes that are drawn/painted. This is the first app that easily projects a painted version of one or more frames on the underlying material and the result looks consistent (instead of processing each frame in Studio Artist for instance). I am so loving the results. Sometimes I am just watching the frames getting written in real-time. I hope more people get to find out about it and have fun with it. While doing all of this, I also had to learn a lot more about motion tracking, rotoscoping, and what have you, because I was making the shots more complicated after finishing the last. Pushing the boundaries of what is possible. So now I am watching a smoke simulation from Blender being rendered out. That will be comped in After Effects, keyframes processed and painted over, and then through EbSynth, and more work in AE. It is unbelievable how much one can do these days with software that is available for free or cheap (I guess DaVinci Resolve is a good alternative for AE). Your imagination really is becoming the only limit. This video is a great example of how EbSynth can bring really cool solutions. Not only funny animations or deepdreamgenerator movies that make you wonder if there was something weird in your coffee.
Thanks for a great video!
This is absolutely brilliant! Thanks for putting so much effort into your videos!
I was convinced the process was going to take hours to generate the output, but doing all the examples in under a couple of hours means the ebsynth part must have been pretty fast! Super impressed!
Even the softwares name sounds magical
Love your channel man! Really great stuff!!
Glad TH-cam recommended me this video! Awesome work!
Dude this is so sick! Technology is getting amazing!!
The edit at 7:17 and earlier, that grainy, sepia looking transition is absolutely beautiful- you should totally do a tut on that
Looks like it is just a color adjustment with a texture overlay. The transition to the sepia was most likely done with a matte effect.
1. Keyframe the footage layer's scale up to about 105% , over about 12-18 frames (assuming 24fps - do 15-20 frames if it's 30fps).
2. Use either Timewarp, a time remap, or something like Twixtor to slow the footage down to a still frame - and keyframe that to take the same amount of time. About half a second.
3. duplicate the layer. hide the one on top and ignore it for now.
4. underneath the hidden copy, and above the bottom copy, add three things, in this order (bottom to top): an empty Adjustment Layer, an empty Solid, and a paper texture of your choice. Just grab something from like, unsplash. doesn't matter.
4a. Make sure to parent this texture layer is parented to one of the footage layers, so that it zooms in with everything else.
5. on the adjustment layer, add CC toner and tweak the colors to your liking.
6. on the solid, add a Fractal Noise effect. You want this to be nice and subtle, so:
6a. turn the complexity down to like, 1.5 or 2.
6b. turn the scale of the noise up to around 200.
6c. keyframe the evolution of the noise very slowly - no more than 15-30 degrees per second.
6d. add a Levels effect. raise the output black - and lower the output white - both to very close to the middle. adjust this to taste.
6e. add a Gaussian Blur if the noise is still too sharp.
7. set the fractal noise and the paper texture both to Overlay blending mode.
8. re-enable the top copy of the footage.
9. on that top layer, add Extract. animate the parameters so that the top layer goes away bright areas first, over the course of that half second. Increase the softness to make it more subtle.
10. Add "Refine Soft Matte" and turn off "Decontaminate edge colors" or whatever it's called.
11. ...add a paper crinkling sound effect. You'd be amazed how much heavy lifting the sound designers do when it comes to VFX shots.
12. go back and tweak the scale keyframes (of both footage layers!) so that the zoom in a little slower than the other parts of the transition.
That should be it. Tweak all the keyframes and settings until you like it, and you're done!
Keep in mind I didn't test this out, I'm just coming up with this on the spot. I think it should get you pretty close to the same transition, though.
@@MorganWable thanks for this!
@@MorganWable sounds like a tons of works
HOLY HELL!
SO glad that I got your video in my recommendation
Love your unique style and amazing tutorials!
You got a new subscriber 🥰
Wow! Instant sub. This is mental. LOVE your trick of masking the face and then having EBSynth animate the mask! Just that on its own is worth grabbing EBSynth. I'm going to have some fun with this!!!!
Your channel is waiting to blow up! Very interesting stuff you're doing, and so well presented.
Oh....Oooh...OH! Wow! Fascinating, very fascinating....
Thank you very much, this has been very inspiring and enlightening. Best of luck in the new year with any upcoming projects, count me as a new subscriber!
this is probably the most unique way i've seen ebsynth be used. thank you for the ideas
This is a great tutorial, dude. A few editors have been trying to convince me to use EbSynth for months now but I've convinced me. Nice work.
Superb tutorial, so much appreciated!
Love your videos man, amazing content full of new things to be learned. I know there's a lot of tutorials on color grading in AE but would love to see your technique and approach! :)
I can honestly say that your videos are some of the best out there on these topics, Ive been learning after effects for the past couple of months and these videos are perfect in every way for my situation, I know the basics, but Im not a proffesional. you. are. amazing.
Hey thanks so much, I’m really glad to hear I’m helping so many people out :)
Thank you so much for this tutorial, it will certainly come in handy!
thank you for mentioning how EBSynth handles transparency. I've been scouring the internet for this info
This is exactly the channel I need. Perfect.
This the new best channel that I recently discovered.
I always thought about style-transfer when thinking about EB Synth but using it for visual effects and tweaks is genius! It'll make changes of texture and materials so much more convinient and the tutorials as thourough as always! More people need to see this.
Great video - just started using EbSynth this year myself
Brilliant and detailed tute. Thank you!
extremely well put together tutorial! gonna watch all the others! hope you keep doing these tutorials, you take things at the right pace and pay good attention to what the next step is and making it clear to the viewer what to do and how it is called etc.
lil broke english but you get the point lol
Really Cool! Thanks for the info!
thank you academy of edits for making me a little more academical with every your video
This was super helpful! I'm using EbSynth now to make sith eyes on star wars characters, and other changes. Your tutorial was vital in my understanding, and also for the advanced settings section. Thanks so much for this!
Awesome, I’m glad to hear it! If you ever end up posting what you make, let me know!
@@AcademyOfEdits I actually just made a star wars edit here: th-cam.com/video/bEjDfuKwCwQ/w-d-xo.html
all of the eye edits were done using EbSynth! As well as turning a low quality clip into something HD! (i took a frame from the original sequence, and put it through an enhancer site and used that as the reference frame!)
Wow you did great it looks awesome! Also I never thought of upscaling/enhancing a frame and running it through that’s really smart
This was amazing!!
nice man really useful keep up the good work 😍
This is actually awesome.
i wish i knew this info before trying about a dozen different renders only to get terrible results. i think you have sparked my interest in EBsynth again. thank you
videos like these make me more motivated to make vfx projects
Thank you for your video, my brother and I are testing EBsynth for out real videos to Animations and we are talking about expanding to doing our short Syfy movies using EBsynth as well, your video showed that would can accomplish the type of effects process we are looking for without breaking our bank account using a mix of tools but EBsynth being one of the main go to tools.
Quick comment on the advanced settings used in this video. They slowed my render down lots. A two hour job became five. Worse I had a classic AI overfitting problem leading to distortion which disappeared when I reran using the defaults. The author does a great job in this video explaining why he made these choices. My project was very different (de-aging). Just giving a heads up to perhaps try the defaults on a small clip depending on project type to avoid wasting lots of valuable time.
This is a really good video. Thanks
Best youtube recommendation so far!!
Okay, now that's purely magic
Thank you! Its a new way for cleanup
this was great! subbed
in love with you whole chanel
Well when you put it like that it’s simple. o_o. Actually I didn’t understand most of this, but it was amazing and I subscribed and I’ll watch more. Thanks for putting this out there.
Wow, that’s insane! Thanks so much for sharing!
P.S. looked up your other videos - awesome stuff, subscribed. God bless TH-cam recommendations
No clue how you only have 2.7K subs, keep up the incredible work bro!
Damn.... what a content!! Keep pushing!!
this is a tutorial i never knew I needed
the luma matte was genius
this is amazing
This is dope man, make more videos please.
I just knew about this and I love it.
Amazing tutorial 😊 subscribed
this is insane i would love to see more (subbed and liked)
Great tutorial
amazing video, as always ;)
I learned something from this. thank you.
i just want to said that its beautiful tutorial
This video was probably a lot of work to edit. Great job!
high key i couldn't tell much of the difference of the slughorn edit until you explained them-- wtf
pure magic
Very informative! Also, your tutorial has no fluff... it is all content! 👍
Welcome back!
I kinda knew about all of this, but rotoscoping with EbSynth is literally genius oh my god
SUPER PRO
You deserve more subs!
This is great. I recently made a video about EbSynth as well, but I haven’t tried using multiple keyframes yet. I’ll have to give that a try. Your workflow seems very refined! One question though- is there a reason why you chose to use a Luma matte instead of the new Rotobrush in AE? I was assuming just to show what EbSynth can do but I wasn’t sure if there was another reason. Anyways, great job and I can’t wait to watch more of your videos!
This is FREE? I was expecting it to cost a ton. Can't wait to try it out!
finally - videoshop! :)
Awesome!
I read the text of the tumbnail as: "Why editors need absinthe", and thought it relatable.
Then i read the title and thought I'd be seeing someone attempt to edit clips from Harry Potter, while drinking absinthe.
I was mistaken, but I've learnt something new.
Talent!
dang. this is going to blow up soon
This program is insane.
Have my SUB, great content!
Nice trick with the Luma matte. Personally I would have opted for the Roto Brush, especially with the new 2.0 out now. But it's a toss up how well that would work in the low-lit shot.
What a dopeass channel discovery! Instant subscribe with both my accounts.
AI effects are getting crazy! Been using skeeter to isolate the vocals from movies, it worth insanely well and fast!
this is huge
It's really scary that you can actually change an actor's performance with this. re: Normal to Sulky potter
your voice is so nice!
Last year, I was slimming brides' faces in wedding videos. With this program: D
This is going to a whole new level
@@KnutNukem :D
@@dogukankrkclar7730 please don't tell I'm it's some standard practice... I'm fed up with only basic correction per clip. Can't imagine slimming down one person in each shot of a longer video. I'd return the money tbh
"The easiest way is to add white to the luma matte"
Oh, why didn't I think of that?
So easy!
When I studied film/video, Final Cut and After Effects were near mythical programs that very few non professionals had access to. I was doing image sequence edits in Photoshop FOUR, manually, frame by bloody frame. I once spent 8 hours on an exploding head. The technology coming out today, especially the open source freeware stuff, would have been UNTHINKABLE back then. Low budget indie filmmaking has become accessible to all. . . for better and for worse. Can't wait to see what cheap/free software will be capable of in another 25 years.
Good job.
holy moly
I agree
Thank you! ;)
nice video tnx
this is like a VFX artist's dream
Aw man, I would so use this program to change the style of the ties for their uniforms to match how they looked in the first two Harry Potter films
really intersting video
I have only little experince with editing,
how much time would you probably need to pull off those effects on the same quality level without being able to use ai tools?
cool vid, for the slughorn edit would it have been easier to just copy his whole face to a new layer to edit than use that as the keyframe?
Using EbSynth to create the luma matte instead of rotoscoping was genius
Hi there, I just found your channel, great content, very useful! I have question, in 5:33 when the "yuck" appears, how do you do that? everytime I tried to do something like that I had to use a caligraphic font and then with strokes, trims and alpha channels make it appeared as "written", I can see by looking frame by frame that you use a different technique to achieve this because the lines in the K of YUCK appear on top of each other as individual lines, I am curious about it, hope you can share. Thanks! Edit: had to correct some spelling, not native english speaker here :)
Great Video, very handy tool. I have a feeling that they used ebsynth to get rid of Henry Cavill's mustache in Justice League lol
This video is great and the results you achieved are awesome! I'm a little confused as to why you only used the edited parts of the shirts in ebsynth. Why not just use the full image? Great job!
Thanks! The reason we ideally want to isolate the ebsynth output is because if we feed in the whole edited frame and have ebsynth output whole frames for us, then we won't JUST be mapping the edited shirt onto the shirt from our footage, we'll be mapping EVERYTHING from the frame we chose/edited onto the video. So for example we'd be mapping a photo of harry's face back onto his actual face for no reason when all we want is the edited shirt
@@AcademyOfEdits ohhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh that makes so much sense now!!!!! thank you very much for clarifying this :)
So do you recommend to low the "Diversity" value and rise the "Mapping" value?