Mixing Different Framerates - The Ultimate Guide
ฝัง
- เผยแพร่เมื่อ 16 มิ.ย. 2024
- ▼▼▼EXPAND FOR CHAPTER NAVIGATION▼▼▼ (1 UPDATE AT BOTTOM)
Play World of Tanks here: tanks.ly/3UaCj8E
Thank you World of Tanks for sponsoring this video.
During registration use the code TANKMANIA to get for free 7 Days Premium Account, 250k credits, the Premium Tank Excelsior (Tier 5), and 3 rental tanks for 10 battles each: Tiger 131 (Tier 6), Cromwell B (Tier 6), and T34-85M (Tier 6).
The promo code is only for new players during registration.
Check out the WoT merch on Amazon: amzn.to/3HhfIkG
0:00:00 WHEN MIXED FRAMERATES GO WRONG!
0:00:51 Fundamental Principles for Frame Sampling
0:01:31 World of Tanks!?
0:02:46 What causes stuttering
0:06:45 Editing example - when to allow stuttering and when to not
0:12:40 Removing repeated frames in a rendered video
0:14:03 Skipped frames in a rendered video (can't be fixed)
0:15:19 How ALL framerates will fit into all other framerates
0:18:43 stuff is always trying to use as many frames as possible, basically.
0:19:56 Nesting.
0:20:59 Always film at the most appropriate framerate
0:22:51 Shenanigans with 60 FPS
0:25:10 Filming B-roll at 60FPS, then playing it at 30
0:26:02 Changing the VISIBLE framerate
0:29:14 Frame Blending! How it works!
0:32:53 NEVER use frame blending to convert 24 to 30, or 30 to 24. (Or 25.)
0:35:16 So, when is it actaully appropriate to use Frame Blending?
0:40:24 Deliberately reducing the framerate with "Posterize Time"
0:42:59 Optical Flow! How it works! How it goes wrong!
0:48:12 Do not use Optical Flow across cuts! (And how to fix it)
0:53:25 A.I. Interpolation!?
0:55:04 Interpolated frames do not look as good as the original frames they are based on.
0:55:51 24 into 30 with no stutter??
0:57:09 Just how fast and slow should we go?
1:00:33 JUDDER! (It's different from stutter!)
1:03:50 Stutter AND Judder at the same time?! (Light bulbs image)
1:04:55 Let's talk about SPEED RAMPING!
1:06:26 Vector-based interpolation?!
1:08:30 "My Clip Speed Changed From What I Told It?!?"
1:08:48 Variable Framerate Clips and How To Re-Sync Them
1:10:05 The Rate Stretch Tool! It's GrrrrRATE!
1:10:40 The Frame Hold and all the ways it can go wrong
1:11:56 Pulse Width Modulated Lighting
1:12:25 TV motion interpolation - TURN IT OFF FOREVER
1:14:44 Variable refresh rate on your TV/monitor!
1:16:26 Fractional Framerates and Why I Hate Them
FREE LINK! github.com/TaranVH/29.97.AEP
1:24:41 Screen capture footage: 30.00 or 29.97?
1:26:01 THE END!
UPDATE:
I forgot to explicitly mention an important workflow detail:
Basically, WHEN YOU GET PRETTY MUCH ANY FOOTAGE, after you import it into Premiere (or whatever NLE you use), before you put it onto the timeline, YOU SHOULD CHECK THE FRAMERATE. Do not assume that it will match your timebase. It's always possible that the camera operator made a mistake! (The framerate can be checked easily and quickly for lots of footage at once, using the List View in the bin (the bin is also known as the project panel.))
If any of that footage has a framerate that is DIFFERENT from your timebase, then you can use the techniques I've described here to try to alleviate that.
However, keep in mind that SOMETIMES, the listed framerate isn't correct, (visibly) because the clip was ruined by another editor, as described at 14:04. As your editing skills improve, you'll be able to spot a framerate mismatch like this while playing the video at 100% speed. (You will never notice a framerate mismatch at 200% or 300% speed.) However, the best test for this is ALWAYS to just watch the footage frame by frame. While paused, just slowly hit the right arrow key, (to advance by just 1 frame) over and over, and carefully watch the monitor. Repeated frames will immediately become obvious. This will usually show up as one repeated frame per 5 frames, which is what I meant when I say "according to the appropriate spacing" at 13:05. But this absolutely can sometimes be at an interval other than once every 5 frames! The frame-by-frame test will always show you where those repeated frames are! When you spot one, keep going frame-by-frame. Don't always assume that the interval is constant, like I did with that footage from Apple! (Which I then notice and fix at 13:24.)
As mentioned, SKIPPED frames are harder to spot, but can most easily be seen during panning moves.
NOTE that the results of this test may be different depending on if you are using the Program monitor or the Source monitor! The Program monitor is using your Timebase, while the Source monitor is not. The Source monitor always shows your video clips exactly as they are, before they are altered in any way by the Sequence you place them into.
Watch my 4 hour editing tutorial of a Linus Tech Tips video: • World's Most Advanced ... - ภาพยนตร์และแอนิเมชัน
![Fc ครับ ขอแนะนำให้รู้จักกับ "น้องเปียโน" l [Nickynachat]](http://i.ytimg.com/vi/HQU6Q_IYTLo/mqdefault.jpg)
Play World of Tanks here: tanks.ly/3UaCj8E
Thank you World of Tanks for sponsoring this video.
During registration use the code TANKMANIA to get for free 7 Days Premium Account, 250k credits, the Premium Tank Excelsior (Tier 5), and 3 rental tanks for 10 battles each: Tiger 131 (Tier 6), Cromwell B (Tier 6), and T34-85M (Tier 6).
The promo code is only for new players during registration.
Check out the WoT merch on Amazon: amzn.to/3HhfIkG
I feel like in World of Tanks, you can really be the most tank of all time.
World of Tanks is the tank game ever
Next episode sponsored by War Thunder
Which Stand-up Maths video? @01:17:06
th-cam.com/video/3GJUM6pCpew/w-d-xo.html
You actually took one of these sponsorships 😂
All of this could be avoided if you just work at the lowest common multiple of 23.976, 24, 24.97, 25, 50, 54.94 and 60 FPS, which is 1,496,701,800 FPS.
Technically correct... the best kind of correct!
I just know Taran did the math before he replied ;-)
@@TaranVH Not just technically, to be fair. If video editors were written from the ground up to internally work at that frame rate, there would be so many fewer issues with mixing different materials in the same project. No matter what you imported, every single frame would be perfectly positioned, and only the render would need to worry about picking out the right frame to export.
@@HenryLoenwind But wouldn't it take much more time to compute on other hand, though?
No no no, the precise frame rates you refer to are 24000/1001, 24, 25000/1001, 25, 50, 60000/1001, and 60. The least common multiple of the numerators is only 600000. So your video editor only needs to work at 600 kHz frame rate! Not at all unimaginable IMO.
I don't even edit videos or do anything like this I just enjoy watching Taran talk about anything
Sames!!! I just like to hear the dude talk.
That's why I'm here lmao
It's a mood.
I poorly edit videos, but in no way a level of which literally any of this will (currently) be useful to me, unless I stop being a horridly complacent, lazy creechoor (unlikely). Taran "rants" are nice.
@@KittyKatKya creechoor
Some people use them to fall asleep!!
new bible just dropped
fax
based god
This is like Book of Mormon while the ffmpeg fertility ivory effigies are just lying here.
Taran van Hemel (Taran from Heaven)
Bible 2.0 let's gooo!!!
I feel like I should be paying money for tutorials this good.
I agree.
Found you.
same
You are, by watching the ads.
your paying with your soul
Man, I LOVE these videos, nobody will ever put this much effort on the matter. I admire Taran for digging into all this technical BS and sharing it for free.
1:03:30 the reason why they mention resolution is because the calculator is primarily for RED cameras, RED cameras crop the image when set to a lower resolution rather than scaling down.
I'm so glad you covered fractional frame rates here, I was planning on making a video on the topic myself because I'm so fed up with all the misconceptions around them. I've seen far too many reddit and other forum threads where beginners ask whether they should use 30 or 29.97fps and get snobby responses from industry veterans stating that you should always use the fractional ones and that true 30 doesn't even exist.
Regarding Twixtor, I think it's great because of how many different options and parameters you can tweak. Modern AI frame rate interpolation software creates a better result than Twixtor with default settings, but as an editor you can poke around quite a bit in Twixtor to get the perfect look for each clip individually.
And something to add about gameplay footage - sometimes it makes sense to record games with a very high frame rate to later add motion blur through frame blending. Camera footage doesn't need this because there is already naturally occuring motion blur, but games usually either don't have any motion blur or just have some crappy filter thrown on top that doesn't look smooth in post.
Finally, someone who doesn't skip essential subjects and teaches you the whole package
Love these deep dives. As always, will be sharing with my production teams on Monday, appreciate all the hard work that goes into this content.
k
@@ilusions4 rude
@@pcislocked don't even bother man, bro thinks he's him
Wow, this is the best explanation of frame rate than anything I've ever seen. And I've watched a lot of them. And this is the master class of frame rate. It answers EVERY questions I ever had about framerate, and no one else has ever explained it (and make it easily understandable) like Taran.
Never was and never will be a video editor, but this video is packaged so well, I enjoyed every 2nd frame of it.
I forgot I had notifications turned on for you and I am pleasantly surprised! Happy to see a new vid come out, with a sponsorship no less!
HAHAHAHA, the apple impersonation was so good.
I kept giggling to myself throughout the whole thing because it is really funny seeing someone getting so pedantic and even angry about freaking framerates but also I am the exact same way about all this stuff so it was also kinda cathartic to whitness for me! Thank you for going through all the trouble of making this :3
I had to laugh so hard at this comment! Same here! 🤣🤣🤣🤣
In the old NTSC days, 24 fps film was converted in real time to 30 fps by using what was known as 3:2 pull down. NTSC video actually ran at 60 fields per second because video was interlaced video: Field 1 was the odd lines and Field 2 was the even lines.
3:2 pull down showed 1 frame of film for 3 fields and the next film frame for 2 fields. This pattern was repeated for every 2 frames of film with the result being film running effectively at 30 frames per second.
I liked the video almost immediately, the amount of work that has been put into making this video is absolutely insane. There is so much information packed in there, with examples explained in great detail. This video is invaluable source of information. I watched the entirety of it and enjoyed every single bit of it. The balance of theory and practical applications was on point, it was entertaining enough to watch and learn at the same time. Kudos to you, your work is greatly appreciated. This is the type of video I didn't know I needed to watch, but I am glad I did. I am fairly green in editing environment and had some work done that looked wrong, mostly due to mismatched frame rates before and I even had no idea what could be an issue there, or how to work around solving these issues, since I couldn't find the roots of the problem before. The delayed sound issue I encountered on multiple occasions too. This was very enlightening video to me and I believe to many others as well.
While not being a video aficionado per se, I still enjoy being lectured about a problem I didn't even know I had. Great work, Taran!
Well, hello Taran! I watched both of your 3+ and 4+ hours tutorials. You're a great editor and a fenomenal human being! _Abraços do Brasil!_
Taran. You're a gem. Thank you for all of your hard work. Seriously a massive asset to the entire editing community. i ALWAYS learn something new in your videos.
As per usual, Taran pulling out all the stops to release an A+ edited video educating the masses on something they should know, for the low-low cost of $0.
You can't imagine how much usefull is this video for me, i'm working at a company conforming timelines and sometimes we have issues with archive material, now i know how to do it better. I really love this video, and apreciate your time to do it! Thank you for this!
Thank you Taran! I was just the other day thinking about matching frame rates and understanding them deeper. When I saw this video i got so hyped! Appreciate all your wisdom! 🙏🏾
Dude, this is the most detailed video about this topic on TH-cam, BY FAR!
My guess on the Red Pan Calculator is that resolution does matter. As in, the resolution that you set you Red camera to. Many professional and cinema cameras will perform a sensor crop when you drop down in resolution instead of pixel binning. This will increase your footage's focal length as it's only capturing from tighter and tighter crops from the center of the sensor. Thus, for a subject at a fixed distance, when you drop down in resolution you should slow down your pan, so that it's not moving too fast across the screen.
I'm glad that I finished the video. Learned a ton.
Love the long format instead of many short videos which we tend to get distracted after one ends
Excellent video, cannot wait for the next! Cool to see that you are still editing for big youtubers.
I'm going to be coming back to this video for years to come. This is great information for editors. Thank you, Taran.
I'm not a video editor, but I found the topic so fascinating, it really brings into perspective the titanic work that goes into crafting video.
Wow! Very educational video, I watched the entire video and learnt so much. One of the best free tutorials on the internet. Thanks!
i edit videos very rarely and was aware of that framerate stuff... but that deep dive is great, so much new knowledge! and thank god i understand what you telling
Taran is a gift from the Editing Gods.
I think I was actually waiting for you to make this video but I didn't even know it yet.
Exactly what I needed, thanks!
Thank you for quickly covering the very basics of EVERYTHING you’re explaining. There are many things you don’t usually learn anywhere else.
I know you ment this to be a short video about 24p/30p/60p but i'm happy you went above and beyond. Because i knew about that from countless other videos. But all the other stuff is something i'd only find on your channel. Thanks a bunch!
I love how your videos are long and in-depth. Thank you.
Excellent explanation. Was wondering for a long time where those stutters came from. Thanks.
I don't even edit videos too often, but I watched the whole thing. You're really good at explaining and visualizing things in a captivating way.
Every time I think I know a lot about editing, I just watch another from you, and all my pride gets crushed down to a more humbled place 😂 (thanks for taking the time, I always learn so much)
One of the most entertaining and engaging videos I have ever seen, I'm not even kidding. Please make more!
Great video as always, I've learned so much from you
A very useful video for a newbie, but maybe for some experienced videomaker too. There is a lot of information explained in a clear way. Probably the longest video I ever watched on TH-cam, and I will watch it again. Thank you. 👍
Thank you so so much
Framerates and Tanks, my favourite two topics
Judder - that's the word I've looking for for many years! Thank you!!!
This was a very engaging video for the entire one and a half hours. Well done scripting Taran. 👍
I was wondering when I would see a new video, Great content brother keep it up!
thank you for these types of videos, they're awesome
Thank you so much, Taran, for the incredibly helpful tutorial on frame rates! Your clear explanations and step-by-step guidance have made a significant difference for me. I've watched this video multiple times, and each time I come away with a better understanding. Your dedication to creating informative content is truly appreciated. Keep up the fantastic work! ❤
1. the detect-edit portion to apply optical flow might be easier by nesting the individual shots. optical flow is then unable to use visual material of the next shot, which we don't want. this should result in a consistent length as well that syncs with the slowed audio if ever needed. you could also preemptively remove 1 frame at the end of every shot before slowing the shots down, should also work but makes the entire thing shorter like you said.
2. i used twixtor back in the day when optical flow wasn't a thing (in after effects too) and it was really cool for it's time but with optical flow as a native feature i don't think it's worth it. it has pretty much the same issues.
Despite the comments memeing about the duration and level of depth of this video, thank you for providing valuable in-depth lessons on these things. Your presentation is easy to understand and I learnt a lot, as I'm looking at getting into video production and am facing a choice of what format to use.
Keep up the brilliant work.
Your videos are so painfully helpful. haha. Thanks for the effort you put into these. Tons of resource here, even stuff I already knew.
Absolut treasure trove of framerate information here! Thank you
This is a great video. A couple of the problems you mentioned could be solved using third party programs like ffmpeg. For example, I would never input 29.97/30 ABCDD footage into a 23.976/24 Premiere project, I would just drop the frames before and transcode it to a lossless codec. Your method of manually blocking all of the dupe frames out and then cutting and combining them is super time consuming and cumbersome when you could easily do it with ffmpeg, or even probably some third party front end like Handbrake if you wanted a more user-friendly GUI. Same goes for interlaced footage if you're importing HDTV/DVD, just deinterlace/IVTC it before it ever even touches Premiere since Premiere sucks at it. This applies again to variable framerate footage, there's no reason to ever import VFR into Premiere as it can't really handle it without losing audio sync. As a side note, I was excited to see at the beginning you were maybe going to explain why Premiere ANNOYINGLY changes 23.976 to 23.98 even though they're clearly different things. This can occasionally lead to weird problems with already edited/cut 23.976 footage where the beginning or ending in/out frames are off by 1 on a "23.98" timeline. Super frustrating. Thanks for everything, nice to see you thriving, looking forward to future videos!
Outstanding work. Thanks!
Very cool video! Thanks for explaining this. I learned a lot!
Even tho I don't edit on premiere, this will be hugely helpful. I can't thank you enough for sharing this invaluable information!
i dont understand anything about it but im sure its pretty important stuff for ya and helping out those who need it, so great video!
thank. this helps a lot. mainly the fractional frame rate. Also explains why I couldn't mix some gopro footage at 29.97fps and camera at 50fps, had a feeling it was to do with that after a lot of frustration but now makes a lot more sense
holy shit taran! first video im seeing after ltt. so proud of you man!!
amazing video.
holy moly, I have been watching for one hour and half, damn, thanks for putting this together
This video is a MASTERPIECE! Super helpful and I feel like my pain is finally being understood! Spread awareness!
This is so much good information that deserves so many more views. Thank you!
mp4 containers actually can use a variable framerate. It's just that most editing software can't do that and a lot of software isn't expecting it.
You can even put a 60 fps video in a container that says its 30 fps. Premire will retime the clip to 30 fps while vlc will play it at 60 fps while telling you it's 30 fps.
Just in case you want to want to manipulate video metadata at some point ;)
Wow, Just watched the whole vid. Here I go playing it again! At least another 6 times to fit it all in my brain 🤣🤣Great stuff.
Love these videos! Can't wait for the next one!
it makes me happy seeing a video from you again
Amazing video! Thank you for all the time you put in it!
This is very informative. Thank you!
WOW this video is AMAZING in all departments.
this is exactly what I need right now, you're amazing Taran
There's so much stuff I didn't know I didn't know. Probably need to watch this like ten times to fully understand this stuff.
Excellent. Very thorough, and thus very helpful. :) Thank you!
1:18:30 The one camera I know lets you shoot in 23.976 and 24 frames per second is the Blackmagic Pocket 6K Pro
I'm pretty sure other Blackmagic cameras can also do it, but I haven't seen anything about 30, 60, or 120. It seems like they only added the option of 24FPS.
Exactly what I was about to mention. I switched to my BMPCC 6K for this exact reason. I hate using my Sony.
I think the Panasonic GH5 can also do 24.0, but not 30.0 or 60.0.
I was going to say this. To be specific, the pocket 4k can do 4k DCI 23.98, 24, 29.97, 30, 59.94, and 60. I'm going to assume the Pocket 6k can too. The GH5 II and GH6 can only do 24p.
@@edb2720 good to know!
most cinema cameras can do it, but anything less than that gives you 29.97
You’re really good at editing videos!
Excellent video. Framerate mismatch is always a pet peeve of mine, I seem to notice it even when friends and family don't. A personal trick, for complex or messy sources like 'old footage' which may be improperly telecined and/or (de)interlaced, fixing the source with ffmpeg before it even hits the timeline can allow massive improvements (at the cost of extra steps, storage, and transcoding)
I recently purchased Topaz Video AI and the tool I use the most is the framerate conversion; so far I couldn't see any artifacts.
It's very useful, especially when mixing stock footage.
So much useful information. Thank you.
actually had super valuable info in here I had no clue about. cheers!
Watched and understood the entire Video! Thanks!
That was great Taran!!
great to see you taran
keep making video videos
thanks :)
You must love your craft because you are a master. Amazing video thanks for sharing
NGL Taran, I didn't think I'd watch the whole video but your presentation was super engaging! Also, the arri Alexa minis we use at work do have true 24/30/60, but we still shoot dropframe for whatever reason lol
Feels good to be a chosen one :)
Great video, hope the algorithm picks this up!
Haven't even watched and I'm still happy. Thx
great, thank you for put it together!
Thanks for this video! Super informative, not to mention hilarious 😂
Amazing work, thank you SO much!
I am about to edit my first video with clips in different frame rates (mostly talking) and I was terrified. Parts of this video helped me to understand the basics and now I don’t feel as lost as before. Thank you.
Taran, you never cease to amaze and teach me something new. It was from you that I learned to use 7+tt just to display the seconds on the taskbar and the importance of 16:10 monitors. Now I see that you used fake folders just to have “groups” in the list of folders on the file explorer (as seen at 7:37). Damn!
**********
I hope to one day be half as productive as you are.
**********
Was literally just wondering yesterday when Taran was gonna drop a new video, so crazy.
That was a masterclass, I am so glad you exist. Thank you Moon-Master Taran.
Awesome video! Thanks!
First time I bump into your content and that was a very lenghty and in depth video xD
But incredibly well-made 🤩
In one sentence: My brain is melting, I loved every second of it 🤣
A good practice for variable framerate footage would be to transcode it to an intermediet codec (prores/DNxHQ) or any other codec of your choice that uses fixed framerates.
That would lock audio and video as they are avoiding the sync/ issues you experience editing it natively (without transcode first).
And that's much easier/faster than shift andio every paragraph manually.
Love your work, im an editor myself and i usually learn allot from your videos. So thank you very much and keep up the good work
Ironically for the content of this video, the "Film mode" on his TV at 1:13:55 is supposed to detect when 24fps content is being played with repeated frames and play it correctly at 24fps (well, actually displaying repeated frames at the 120/240fps refresh rate of the panel and having it evenly divide to 24fps).
15:53 I basically did this for years and still do it sometimes, although it made some parts of my videos look weird for example my phone's rear camera can do 1080p 60 but my selfie camera can only do 1080p 30 so I would just set my timebase to 60 every time if I was using native 60 fps clips or 30 fps clips but as soon as I got a Camera that can do multiple frame rates I generally just stick to 30 now or 24 if I'm doing cinematic style video. I only ever shot at 60 all the time was to always be able to slow down a clip in my videos although nowadays I don't do that as much so back to 30 it is.
Wow. This video auto played for me and THANK YOU so very much for SLOWING down to a pace I can understand! I like Gerald Undone but absolutely cannot keep up with him. It's like he's drank 10 espresso shots. Haha.