Vfx artist here been a really huge help using syntheyes and Mocha pro for tracking instead of AE alot easier and comfortable thanks for making it possible
It automatically does this on the first solve. There is currently no manual "refine" stage as there is with SynthEyes. This is a good feature request for future versions.
Congratulations on your tutorial. I would like to see how to integrate all of this into Davinci Resolve(Fusion). Are you thinking of doing a tutorial soon?
Yes, definitely. We were just waiting on a couple of Fusion features to be changed. This started in v18.6.6 and has be fully implemented in v19. Be on the lookout for some Mocha Pro / Fusion tutorials really soon!
please make a tutorial on green screen shots with tracking markers! I always use cinema4d or AE 3D Camera tracker but seeing Boris FX finally coming up with this is beyond amazing. I would definitely switch it to this new camera solve module but I would love to see the workflow tutorial first
We have shots like that. It's worth checking out this part of the Mocha Pro 2024 livestream we did recently. That should help you : th-cam.com/users/live4z9TYNIAWmM?si=84Xbr8hJfTNOEZbE&t=2471
Exactly the same way. The drone shots we tested worked as well as any other. Be mindful of moving objects and glittery things (mask them out) and you should be good to go. Bear in mind that some drone lenses show an extreme amount of lens distortion. You may have to render an undistorted version through the Lens module.
I have a problem with tracking. camera solve creates extra points where they are not needed at all. Is it possible to delete them without reappearing and re-track the video?thank you for video!
When it makes sense to use it. In all our products we use Machine Learning to solve tasks that cannot be solved better with other methods. And we're always looking at pushing this technology forward.
Hi, thank you for the tutorial but i think mocha should place syntheye into mocha pro now and we should have advance options like 3d camera tracker of after effects but more robust! im sure Boris FX can do that.
We don't currently generate meshes from sparse points, but meshes are generated from the PowerMesh tracks. See the tutorial here for more details: th-cam.com/video/s-fUh4880Es/w-d-xo.html
Mocha automates checks for zooming lenses so will keyframe the focal length accordingly. We can track blurred backgrounds, but it's highly contextual to the shot whether you get an accurate solve in blurry scenarios. Free moving cameras aren't really a problem as you can solve most moving cameras, handheld or otherwise. For complex shots, we recommend SynthEyes as it has dedicated tools for supervised 3D matchmoving. If you're having trouble getting what you need from a solve in Mocha, we also export SNI files so SynthEyes can keep working on the shot.
One question that will maybe cause a challenge. Is it possible for each demonstration, an integration for nuke / vegas / ae / fussuion resolve? This will make the content relevant for all the platforms and not guessing all the time, especially for less experienced people on anything else than AE
We will be making more host-specific tutorials along the way. We try to focus on the basics in one host as not to confuse the process too much, then expand out into the other formats. Each host handles 3D import differently, so a single video that covers all of them would be long and complex. But rest assured! We will be adding more videos.
We don't ustilise the core graph parameter system from SynthEyes. This is a simpler approach. You might have to elaborate on what you mean by "overlapping shot". Mocha only tackles one camera at a time!
I think there's an error in what Ben says at 8'00 in. He said that the parameter for focal length is the '35mm equivalent' of the focal length. Since the film back since is part of the imputable data, I would say that this number is the actual focal length, not the focal length translated into 35mm sizing. You could leave the film back at a standard 35mm size and translate the focal length to match, but that point wasn't made so clearly. If you changed the film back size to match a Super16 sensor/scan, and entered the focal length still in 35mm equivalent, then this would produce erroneous results. I know this video is made for basic operation, but still....
You hit the nail on the head with your last sentence. This is a "first steps" video, so an in-depth discussion about the Film Back parameter would be out of place. You are also right that this point wasn't made as clearly as it should be. I'll put this link to the documentation so that viewers of this thread can easily find more information about this area : borisfx.com/documentation/mocha/11.0.0/#camera_params Thanks so much for the valuable comment.
Thanks for the question. Most of Mocha's tracking is processed on GPU or CPU depending on the preferences. Presently all camera solves are calculated on the CPU only.
Hello! Mocha Pro is available as a plugin or a standalone application (win/mac/linux). As a plugin, we support Adobe Premiere and After Effects, Avid Media Composer, Nuke, Flame, Fusion, VEGAS Pro, etc. Regrettably, Mocha Pro does not support FCP....at this time 😉
If you need accurate tracking, roto and clean up tools but also have to use 3D elements in your footage, Mocha is the best tool for you. If you have a lot of day-to-day 3D match moving, difficult or complex shots to solve for 3D or you work in forensics, SynthEyes is an excellent choice. Mocha will also export SynthEyes projects from the Camera Solve module, so if you’re stuck on a 3D solve in Mocha, you can finish it in SynthEyes. And both have free trials, so you can find out which one works better for your workflow : borisfx.com/downloads/?product=boris%20fx%20hub
The best approximation of surpervised tracking comes in the form of Mocha planar and mesh tracks that can be added to the solve. But SynthEyes isn't going anywhere. It's an amazing tool for complex 3D match moving, shot surveys, GeoH tracking, etc.
You can select three or more trackers and automatically align the ground plane to them. Then you can select the scene at the top of the 3D hierarchy, and manually align it how you want. If you want even more control of the different axes, then you can export the data to SynthEyes and do your finetuning there.
You can export FBX out to Fusion. There is currently an issue with Fusion not importing all keyframes correctly in some circumstances. Blackmagic has been made aware of the issue. We will be releasing an update in v2024.01 that helps in many circumstances, but the ultimate fix has to come from Fusion.
Of course! SynthEyes is a deep program with literal decades of tools focused specifically on match moving. It is still the go-to tool for complex camera solving. Like we did with Mocha tracking, we're simply sharing tech across the Boris FX products for a better experience in specific features. We're not replacing SynthEyes, it's still being very actively developed.
Not at all. Both Silhouette and SynthEyes have specialized tools for tackling tasks and projects that Mocha cannot. Mocha _enables_ other software so you can do more, faster.
Cross-integrating the technology we have at Boris FX is a great way to add depth to each product with tools users are already familiar with. Additionally, this means Mocha users get to utilise the planar tracking and PowerMesh approaches they already know to assist the 3D solving, as well as use Mocha rotoscoping tools for masking. In the same way we added Mocha tracking and masking to Sapphire, Continuum and Silhouette, adding a simplified set of SynthEyes solving tools to Mocha makes 3D workflow much easier for Mocha enthusiasts.
@@BorisFXco OK. so After re-watching this video, I've agreed with your decision. Syntheyes is best but it takes some time to get used to working gin. you guys have brought the same engine into Mocha but with a much user-friendlier UI. A quick question, I stand to be corrected, Do you guys plan on adding Mocha's amazing planar tracking power in Syntheyes? for users that would like to create garbage matte in Syntheyes
SynthEyes can sometimes seem daunting with the vast amount of match moving tools. As you can see from the channel, we're also updating the training for SynthEyes to make to core tools clearer! The Mocha Camera Solve approach is designed to be friendly to the usual Mocha workflow which makes it feel more familiar.
![Mocha Pro: Better Camera Solve Results - Masks & Meshes [Boris FX Mocha Essentials 22b]](http://i.ytimg.com/vi/s-fUh4880Es/mqdefault.jpg)
![Mocha Pro: Better Camera Solve Results - Masks & Meshes [Boris FX Mocha Essentials 22b]](/img/tr.png)
![SynthEyes Essentials - 01 Introduction to 3D Matchmoving and Tracking [Boris FX]](http://i.ytimg.com/vi/IIF1Htbog_o/mqdefault.jpg)
![Quick Introduction to Mocha AE - Complete Walkthrough [NEW Boris FX Mocha AE]](/img/n.gif)
I am so excited by this addition to the toolset! I can't wait to see the advanced tutorials.
"This is simply amazing! My anticipation for this moment has been rewarded. Thank you for making this possible."
Excellent! We are glad you are enjoying the update.
Wow congrats on this. The old camera tracker was pretty handy, but It is very nice to see it as a full feature tool with more purpose now.
Vfx artist here been a really huge help using syntheyes and Mocha pro for tracking instead of AE
alot easier and comfortable thanks for making it possible
That's great to hear. Glad you're enjoying the tools!
i like this update, the only thing i would add as a feature is maybe to add an error threshold parameter to cutout bad trackers?
It automatically does this on the first solve. There is currently no manual "refine" stage as there is with SynthEyes. This is a good feature request for future versions.
Mocha has always been at the forefront of the industry, its updates are always interesting.
Thank you for the kind words.
i was waiting for this! amazing
I've been looking for a 3d camera tracker for the longest time since tutorials for Boujou aren't common!
Congratulations on your tutorial. I would like to see how to integrate all of this into Davinci Resolve(Fusion). Are you thinking of doing a tutorial soon?
Yes, definitely. We were just waiting on a couple of Fusion features to be changed. This started in v18.6.6 and has be fully implemented in v19. Be on the lookout for some Mocha Pro / Fusion tutorials really soon!
mocha + Syntheyes 🔥
please make a tutorial on green screen shots with tracking markers! I always use cinema4d or AE 3D Camera tracker but seeing Boris FX finally coming up with this is beyond amazing. I would definitely switch it to this new camera solve module but I would love to see the workflow tutorial first
We have shots like that. It's worth checking out this part of the Mocha Pro 2024 livestream we did recently. That should help you : th-cam.com/users/live4z9TYNIAWmM?si=84Xbr8hJfTNOEZbE&t=2471
Thank you for the updates. Can we create mesh geometry from the camera Nulls in Mocha?
Depending on your target application, yes. You can also export PowerMesh points directly as 3D meshes.
Awesome tutorial. Curious though how a drone shot might be solved in this new workflow.
Exactly the same way. The drone shots we tested worked as well as any other. Be mindful of moving objects and glittery things (mask them out) and you should be good to go. Bear in mind that some drone lenses show an extreme amount of lens distortion. You may have to render an undistorted version through the Lens module.
learning, learning, learning, Cheers!
I have a problem with tracking. camera solve creates extra points where they are not needed at all. Is it possible to delete them without reappearing and re-track the video?thank you for video!
Yes, turn them off in the 3D Layer Panel on the top right hand side of the screen. You can choose what you export there.
Looking forward to trying this out. When will you use Ai to help solve?
When it makes sense to use it. In all our products we use Machine Learning to solve tasks that cannot be solved better with other methods. And we're always looking at pushing this technology forward.
Hi, thank you for the tutorial but i think mocha should place syntheye into mocha pro now and we should have advance options like 3d camera tracker of after effects
but more robust! im sure Boris FX can do that.
Any way to export tracking points and generate 3d geometry sort of like 3dequalizer??
We don't currently generate meshes from sparse points, but meshes are generated from the PowerMesh tracks. See the tutorial here for more details: th-cam.com/video/s-fUh4880Es/w-d-xo.html
@@BorisFXcoThank you
Thanks Ben, very interesting. What about lens distortion? Can Mocha produce data to unwarp/rewarp etc?
Like with regular planar tracks, Lens distortion in the Mocha workflow is handled by the Mocha Lens module.
How about complex shots ? Where there is focal animation,BG blur or the camera is free moving ? Will it beat 3DE for prod shots ?
Mocha automates checks for zooming lenses so will keyframe the focal length accordingly. We can track blurred backgrounds, but it's highly contextual to the shot whether you get an accurate solve in blurry scenarios. Free moving cameras aren't really a problem as you can solve most moving cameras, handheld or otherwise.
For complex shots, we recommend SynthEyes as it has dedicated tools for supervised 3D matchmoving. If you're having trouble getting what you need from a solve in Mocha, we also export SNI files so SynthEyes can keep working on the shot.
Hey Im trying to join your Discord but it says "Invalid Invite". Any idea why?
It looks valid still here. Give this one a try : discord.gg/hhEnMPvmb3
Hi, can i export the camera track data into blender?
Sure!
Absolutely
@@BorisFXco Thanks. Are there any tutorials for that?
One question that will maybe cause a challenge. Is it possible for each demonstration, an integration for nuke / vegas / ae / fussuion resolve? This will make the content relevant for all the platforms and not guessing all the time, especially for less experienced people on anything else than AE
We will be making more host-specific tutorials along the way. We try to focus on the basics in one host as not to confuse the process too much, then expand out into the other formats. Each host handles 3D import differently, so a single video that covers all of them would be long and complex. But rest assured! We will be adding more videos.
Is there a graph parameters option in mocha?
can you please solve any fast motion or overlapping shot in mocha
We don't ustilise the core graph parameter system from SynthEyes. This is a simpler approach. You might have to elaborate on what you mean by "overlapping shot". Mocha only tackles one camera at a time!
I think there's an error in what Ben says at 8'00 in. He said that the parameter for focal length is the '35mm equivalent' of the focal length. Since the film back since is part of the imputable data, I would say that this number is the actual focal length, not the focal length translated into 35mm sizing. You could leave the film back at a standard 35mm size and translate the focal length to match, but that point wasn't made so clearly. If you changed the film back size to match a Super16 sensor/scan, and entered the focal length still in 35mm equivalent, then this would produce erroneous results. I know this video is made for basic operation, but still....
You hit the nail on the head with your last sentence. This is a "first steps" video, so an in-depth discussion about the Film Back parameter would be out of place. You are also right that this point wasn't made as clearly as it should be.
I'll put this link to the documentation so that viewers of this thread can easily find more information about this area : borisfx.com/documentation/mocha/11.0.0/#camera_params
Thanks so much for the valuable comment.
I just bough Boris PRO and noticed the solve is running on my CPU which is an i51 12thgen. Is there any way to make it run on my RTX 3060ti?
Thanks for the question. Most of Mocha's tracking is processed on GPU or CPU depending on the preferences. Presently all camera solves are calculated on the CPU only.
@@BorisFXco ok ty
Excuse my ignorance. But is this a stand alone 3D tracking editor, or is this available thru premier or FCPX?
Hello! Mocha Pro is available as a plugin or a standalone application (win/mac/linux). As a plugin, we support Adobe Premiere and After Effects, Avid Media Composer, Nuke, Flame, Fusion, VEGAS Pro, etc. Regrettably, Mocha Pro does not support FCP....at this time 😉
What is the difference between Mocha and SynthEyes. Do I have to purchase both or one or another?
If you need accurate tracking, roto and clean up tools but also have to use 3D elements in your footage, Mocha is the best tool for you.
If you have a lot of day-to-day 3D match moving, difficult or complex shots to solve for 3D or you work in forensics, SynthEyes is an excellent choice.
Mocha will also export SynthEyes projects from the Camera Solve module, so if you’re stuck on a 3D solve in Mocha, you can finish it in SynthEyes.
And both have free trials, so you can find out which one works better for your workflow : borisfx.com/downloads/?product=boris%20fx%20hub
What about supervised tracking and does that mean we do not need to use Syntheyes anymore also?
The best approximation of surpervised tracking comes in the form of Mocha planar and mesh tracks that can be added to the solve.
But SynthEyes isn't going anywhere. It's an amazing tool for complex 3D match moving, shot surveys, GeoH tracking, etc.
How could I align the axis with tracking points? Thx
You can select three or more trackers and automatically align the ground plane to them. Then you can select the scene at the top of the 3D hierarchy, and manually align it how you want. If you want even more control of the different axes, then you can export the data to SynthEyes and do your finetuning there.
I bought mocha Essentials course last year do i get the update for syntheyes 3d tracking ?
Yes! We are in the process of updating Mocha Essentials with new lessons, and will email everyone who purchased in the coming weeks.
This update not include mocha pro plugin in silhouette?
Not yet, that will come in an up coming Silhouette launch
Can this be used for object tracking?
Great question. Not currently, no. For object tracking you should look at SynthEyes.
how can i export the camera track data into after effects?
Here’s a video to get you up to speed: th-cam.com/video/wEM6eyrrAgY/w-d-xo.html
Does it work in Fusion?
You can export FBX out to Fusion. There is currently an issue with Fusion not importing all keyframes correctly in some circumstances. Blackmagic has been made aware of the issue.
We will be releasing an update in v2024.01 that helps in many circumstances, but the ultimate fix has to come from Fusion.
How to import this kind track on sillhouette
Currently you cannot use 3D track data directly with Silhouette.
Do we need syntheyes any more?
Of course! SynthEyes is a deep program with literal decades of tools focused specifically on match moving. It is still the go-to tool for complex camera solving. Like we did with Mocha tracking, we're simply sharing tech across the Boris FX products for a better experience in specific features. We're not replacing SynthEyes, it's still being very actively developed.
Great 100%
That means Silhouette and SintEyes gonna desapear?^
Not at all. Both Silhouette and SynthEyes have specialized tools for tackling tasks and projects that Mocha cannot. Mocha _enables_ other software so you can do more, faster.
but why add this to mocha pro when you guys have Syntheyes?
Cross-integrating the technology we have at Boris FX is a great way to add depth to each product with tools users are already familiar with. Additionally, this means Mocha users get to utilise the planar tracking and PowerMesh approaches they already know to assist the 3D solving, as well as use Mocha rotoscoping tools for masking.
In the same way we added Mocha tracking and masking to Sapphire, Continuum and Silhouette, adding a simplified set of SynthEyes solving tools to Mocha makes 3D workflow much easier for Mocha enthusiasts.
@@BorisFXco OK. so After re-watching this video, I've agreed with your decision. Syntheyes is best but it takes some time to get used to working gin. you guys have brought the same engine into Mocha but with a much user-friendlier UI. A quick question, I stand to be corrected, Do you guys plan on adding Mocha's amazing planar tracking power in Syntheyes? for users that would like to create garbage matte in Syntheyes
You had to go an pull out your 28mm and 300mm cinema lens and distract me from the rest of the video! 🤣
Wait until he starts talking about his vintage lens collection. You'll either be 🤤 or 😴😴😴
感觉像是三维扫描里的点云改版
It's a similar idea.
I hate Syntheyes. It's always seemed complicated and impractical to me. Mocha Pro is awsome. Thank you.
SynthEyes can sometimes seem daunting with the vast amount of match moving tools. As you can see from the channel, we're also updating the training for SynthEyes to make to core tools clearer!
The Mocha Camera Solve approach is designed to be friendly to the usual Mocha workflow which makes it feel more familiar.
✨👌💪😎😮😎👍✨