Turn Your iPhone into a Realtime Video Tracker for Cinema Cameras with Lightcraft Jetset
ฝัง
- เผยแพร่เมื่อ 6 ก.ย. 2024
- ► Read more: www.cined.com/...
Lightcraft Technology has released the Jetset Cinema app for iOS. By connecting an iPhone to Accsoon’s SeeMo Pro SDI adapter for iOS and Accsoon’s new CineView HE wireless camera video transmitters, users can convert any camera into a virtual production system. Let’s see how it works!
-----------------------------------------------------------------------------
FOLLOW US:
🎥 www.CineD.com - unbiased filmmaking tech reviews & news
🧑🏻🏫 www.MZed.com - best online education for filmmakers & creators
➡ Subscribe to CineD on TH-cam | / cined
➡ Follow us on Instagram | / cinednews
➡ Follow us on Facebook | / cinednews
➡ Follow us on X (Twitter) | / cinednews
Hell yeah, ever since they started putting lidar on the iphone ive been waiting for this. Cant wait to try it out!
Massive thanks @cined for featuring us. It was great meeting you.
Very cool project. Immediately downloaded it. Is there a way to sync multiple cameras together, like say by designating A cam as the primary perspective? I could see a use for a multi-cam scenario. Cheers!
We are very excited to have Lightcraft join the list of partners that have integrated Accsoon SeeMo into their workflows. Together we aim to provide cutting-edge tools for cinematographers to enhance their creative capabilities.
Love this guy, but damn the subscription again
same here, but i think we can just subscribe only during production. It's still much cheaper than renting any VP hardwares.
I'm very curious. it maybe a game changer for entry level virtual production. good job!
What's crazy is that it's not just tracking but manages the post pipeline. The film industry is just catching on.
Been trying to do this for years with camtrack ar and blendartrack, but the workflow was horrible! So glad this is an option I was wondering when someone would be able to make it happen! So awesome!
Would love to know your thoughts when you try it.
@@JoshuaMKerrhappy to see you with lightcraft joshua
@dpredie Cheers, man. How are you getting on?
Let us know when you try it out!
Very excited by this technology. I have been wondering when camera manufactures will include this capability into the cameras. Hopefully the next generation.
Potentially, just lidar tracking, but by the point it makes its way into cameras, the phone hardware will have matured further.
@@JoshuaMKerr Josh, quick question, just got a PD-Movie lidar autofocus setup for my cinema rig; is there any chance Jetset would, soon, be integrated into this type of workflow? Let us know and keep up the good work!
@GadrielDemartinos Really good question! I'll find out and will probably have to make a video about follow focus setups at some point anyway.
I hope this amazing integration will also work it out to allow send Live Video to the Switcher Studio App which is already integrated with the Accsoon SeeMo
Very cool stuff! Is there a current list of cine cameras that are supported? Would any modern mirrorless camera work..
i didn't even realise the cars were 3D in the opening scene
Does the App support Clean Output via HDMI if the iPhone is used standalone or via AirPlay if used with the Accsoon SeeMo?
Wow Brilliant
This sounds great, now if could integrate autofocus for autofocus motors…
Looks like a very easy to use tracking system but I noticed the 3D model was out of sync (maybe even a lower frame rate) when the camera moved more. I'm assuming it doesn't look like that when it's working correctly, yes? Also the 3D model has to live on the iPhone itself in order for this to work? Wouldn't that severely limit the quality of your 3D model to basically only a temp preview? Also does this mean you can't change the position of anything in your 3D model unless you render out a new one and load it on the phone again?
I think what you noticed is the cineview latency, and just going by the videos Josh has uploaded in the last weeks, once you load the virtual backdrop you will use in the final render, Jetset gives you a quick low rez real-time preview so you can frame and block your scene. The tracking data is recorded, (metadata), and you can bring it into UE, Blender, Nuke, etc, and merge the tracking info with the cinema camera or phone footage with the AAA+ virtual location you'll be using for final delivery in post.
Actually, we were actually doing a full render preview with unreal and were just working out the livelink offset at the time.
The model on the phone really is just so you can compose your shots, and the tracking is unbelievable. Beats a vive easily.
Interesting - does it have the same limitations that CamtrackAR has/had, like being locked to 30/60fps?
Pretty pricey for the casual user but I guess if you were using it a lot, it could be worthwhile
There is a free version. 80 is the maximum price.
@@JoshuaMKerr thanks - how about the frame rate?
That seems like a major factor - not much point using a cinema camera if you're restricted to 30fps?
@@stevegreen9474Jetset Cine works with our Autoshot post processing app. The phone capture is 30fps, but we have a built in digital slate (viewed on a web browser) that the cine camera sees when starting a shot. We flash a set of codes on the digital slate that we use to resync the tracking data to 23.98, 24.0, 25.0 or whatever frame rate the cine camera was shooting at. Works great!
Problem is, the models take up a lot of space. You have to have an almost or completely empty iPhone to use this app. But still, very cool.
You can always connect an ssd
My demo model was about 60MB
We usually compress the textures to save space and to fit the model. The new iPhones handle geo pretty easily. Josh was running full Kitbash3D models in his iPhone 15 Pro!
The price is ridiculous though. Would have been a cool thing to try on the camera.
What do you think would be better?
CamtrackAR has already done this.. like a few years ago..
Yes, but no. CamtrackAR doesn't calibrate external lenses; it's limited to the phone/pad lens. Also, is FXhome still a thing??? Their forum has been dead for over a year now - and no updates!
Yeah he said that
But that is just tracking. This organises takes and syncs them, then sends them to your post software.
As Josh noted we're doing a full cine lens optical calibration with Jetset Cine. So the resulting EXR pulls done in Autoshot have accurate camera data in Blender, Nuke, Unreal, etc.
와... 기대되네요
$80 a month? What?! I'm good.
Let me guess- iPhone only because Apple somehow got the exclusive rights to Lidar in phones. 😑 There's no real technological reason why Android can't have this, Accsoon, full featured Polycam, etc. Just legal and monetary ones. I like creating with new tech but I don't want another iPhone dangit!
Unfortunately, it is just iphone.
There is indeed a technical reason. Apple gives to developer the ARkit, a very powerful camera and object tracking toolset to build the apps with. Android had arcore but it isn´t nearly close to the precision and features of ARkit. It´s not becouse of the Lidar, is the software that sits behind.
If this works as well as it claims, it’s well worth it. You basically pay a guy to track for you $800 a day and industry so this is worth it.