Antilatency | Best tracking system for indie Virtual Production?
ฝัง
- เผยแพร่เมื่อ 20 ม.ค. 2021
- In my search for building a complete toolset for virtual production, I have finally found a camera tracking system that works for me. In this video, I will talk about my experience with the Antilatency Tracking System as well as touching on other parts of my virtual production studio(www.virtualstarstudios.se) like the Glassmark Encoders and general setup I have right now.
If you like what I do here and would like to support feel free to join me at / richardfrantzen
Antilatency did not pay me to do this video but if you're interested feel free to check them out at www.antilatency.com
Online consulting 1-on-1 session available here for a limited time: www.richardfrantzen.se/virtua...
Visit our Virtual Production studio at www.virtualstarstudios.se
Aximmetry, check them out at aximmetry.com/en/
Glassmark Encoders: www.loledvirtual.com/glassmark/
Feel free to ask questions in the comments. This is hard stuff and I love to help when I have time.
Follow me on Instagram where I post more regular updates: / richard.frantzen
Check out my Virtual Production studio at www.virtualstarstudios.se
For questions and other talk join me at www.richardfrantzen.se/forum/...
Join our Discord: / discord
Check out Matt Workmans Unreal Virtual Production Group: / virtualproduction
Great FB group for Aximmetry: / 240516383914797
Link to Aximmetry: aximmetry.com/en/ - ภาพยนตร์และแอนิเมชัน
So finally I've gotten a Patreon-page and to kick things off I've released a Level Transition Blueprint that you just drop into your project to get it working. I will upload a tutorial next week but if you want to get the blueprint right away it's on my Patreon www.patreon.com/richardfrantzen
And if you get the VIP you get access to our secret Discord-channel!
Hey Richard, I need your help please... I have tweaked the codes and have my HMD detected ( there is no HMD) I can see my base and controller but as soon as I unplug the USB I loose the controller and the base.. what do I do wrong..? How to make it work smoothly.? Appreciate if u can spare me a time and reply.. Regards
@@sinanarts are you running the vive in Null driver mode?
@@richard.frantzen Yes I changed the code line in text editor. I have 1 Base Station + 1 Controller only. No HMD No Dongle. Is a dongle must.?
Dongle or connect the vive trackers with usb cable to the computer
@@richard.frantzen Much appreciated. Thank you..
yooo looks great! this definitely looks like the best indie option available, I'm 100% going this route
Richard, you are unbelievable. Thank you for all your help, as well as these amazing videos. They are invaluable.
I had my antilatency stuff picked out, but was waiting for this video before pulling the trigger. I'm so excited - this track looks PERFECT.
Great stuff!! :)
Verkligen inspirerande att följa dig! Har som filmare förstått vikten av att sätta sig in i Unreal Engine 5. Framtiden för alla som vill hålla på med video/film. Dina videor hjälper mig verkligen för att bygga min hemvariant för små behov! Tack Richard!
Richard very nice work and thank you so much to share this kind of information with the community . Amazing man!!!!
Wow, thanks a bunch for the behind the scenes demonstration! Quite amazing tracking. Looking forward to more advances on Virtual Production
You are my hero Richard! This looks so good!
Great to hear that you can sleep well now :) Great Video with nice info, thank you!
This is amazing, thank you for sharing!
Greetings from Singapore. You can say whatever you like cos you guys are rockin! Thank you for sharing so freely Richard, so f*cking cool. Wishing u super success with Virtual Star Studios!
Haha thank you! The same to you!
Richard, thank you! Your video is always the most useful! Thinking about buying Anti latency. We are in the same country where the Antilatency is produced, but the guys from the Antilatency are difficult to contact.
Absolutely Amazing, thanks for sharing. greetings from Timor-Leste
Looks so dope, thanks for sharing! I am considering buying one of the floor systems to film promo videos for my VR app.
My dear friend thank you very much for the great video and all the information's!Greetings from Greece!
Great job. Thanks for sharing.
Amazing stuffs always!
Thank you my friend!!
This is amazing dude, well done!. I am surprised how well the tracking system is working. What are using as a keyer! & KEEP ROCKING! Thats fresh!
Thank you :) it’s Aximmetrys built in keyer
Hehehe...I can see you venting away your pent up stress at 14:51!
Congrats!
Thanks for the amazing video.
Having my baby steps on Virtual Production Universe and GRATEFUL for Richard's personal qualities and professionalism. Thank you Richard. Thank god this Industry has you! I am SİNAN a fan of yours from İstanbul/Turkey who is researching and learning to start a VirProduction studio here in Istanbul.
Thank you very much 😀
@@richard.frantzen May I ask, for the sake of Tracking the Camera Can I use ipad or i phone instead of Vive or Antilatency..? Would it be right to do and effective.?
Yes you can!! You can track whatever you want with Antilatency.
@@richard.frantzen u got me wrong.. With UnrealEngine is it ok to use an iphone to track the virtual camera.? Or its a tool for amateurs.?
I’ve seen many people use an iPad and iPhone to track in Unreal. Works great for fully virtual scenes but maybe it’s a bit tough to get it right if you want to do mixed reality
keep rocking! dude
Yay new video😆
Wooooow ! Perfect !!!! Thanks
Amazing. Thank you.
TNXX SO MUCH u move industry forward БАЗАРЖОК
Thank you Richard for your exiting feedback. We are quite confused about such awesome words. Ofc we want to go further and evolve our product to make it more suitable for all VP needs.
Just wanna be here in the comments if someone wants to ask smthn about our system.
That's great! I think there will be a lot of questions!
Hey Roman, great gadget there Bravo! How many IR markers I need to cover a 3x5 meter green box FROM CEILING and what are the items I need to order from you.? A tracker and what else.? Thx
@@sinanarts hi, to be honest it is better to discuss common questions here. Like technology side or so. For specified cases better to go in email or jump on a call. I don't want to transform this topic into my crm🙃🤣 for you setup you will need two sets of markers ($500) and also you need couple of trackers and sockets. We can discuss your case deeply in direct communication. My email is rv@antilatency.com
@ТРИ СЕСТРЫ if you need to replace the system for only one day I would recommend using floor setup instead of the ceiling. Also, we will release another type of our layout soon. It would be a good solution for such a case. Follow the updates
@@romanvdovchenko9485 thank you for making a great product. We will be in touch!
Goals 🔥
Hey guys, awesome video and I watched it now a couple of times during the last year of my journey in virtual production. What I really would like to know is: Is the key that we see here done and recorded in Aximmetry or did you use the clean recording and used a key from AE or Davinci Resolve afterwards? Tracking looks awesome!
Hi Richard, I had a look at the aximmetry software and, although there appears to be a fairly decent way of dealing with the shadows for the Talent, they do not look as good as the ones in this video. How do you manage to keep the shadows when you are keying the talent?
great !!!!
Congratulations Richard, you are setting the bar for us indie level studios. The results speak fir themselves and do appreciate the detailed behind the scenes review. Gotta get our glass mark encoders working too. What was that rack mount multi source recorder unit?
Thank you my friend! It’s the Atomos Shogun Studio 2
@@richard.frantzen Is it necessary to use these type of hardware to record the video? or aximmetry inbuilt recorder is enough?
No you can record in Aximmetry! But since i do multimachine i would like to see all angles at the same time and also mix between them. The shogun acts like a vision mixer as well. Could also be a Atem Mini instead
But lots of our clients are doing post in Avid so we need to be able to record in Avid Dnxhd etc. and I feel a hardware recorder is more solid and safe
@@richard.frantzen thank you so much
This rules!
thanks for the information .
I like to tear VIVE Trackers apart too . don't worry you could say that :D
very informative, thanks for sharing,
Will it work same way in front of big led screen like 50 feet * 20 feet, or the light of screen and set light will affect the tracking?
Hey Richard, really enjoyed this video and its great to see what's possible with the Antilatency system! I am really keen to know more about how you think you could improve this system. I noticed on all the wide shots where your feet are visible and the camera is moving there is some visible sliding and drifting or wobbling (basically I can see the tracking is not perfect like Stype for example). Is this something you are aware of and are working towards fixing? Is this something you think can be fixed within the Antilatency system? Do you think this issue is coming from the lack of Genlock and could be resolved by integrating the Eztrack system for example? Really keen to know your thoughts on this. Great work!
Awesome video Richard, and thanks a lot for sharing this fabulous experience. May i ask you why to you use Aximmetry and not directly the unreal editor? and what version of Aximmetry did you choose for virtual studio applications? thank you
Aximmetry will allow you to do many funcionalities easily. For exemple: The chroma key is super simple and fast to get good results. On Unreal is possible as well, but not easier that in Aximmetry. Another exemple, the camera movements are easier on Aximmetry..
The realism on this video is impressive ! I'm working on the "Studio TV kit" model offered by Unreal, but I can't get the same rendering. I activate the ray tracing, and modify some settings, but it must be more complicated than that. Do you have any ideas or advice for me? Thanks
I'm uber far from setting up anything even remotely connected with virtual production but I love the Unreal, I love the subject and I LOVE the way You share and what You share. Thank You Thank You !!
I'm supper surprised, how come one layer -ceiling- of trackers is able to track y/z position of those tiny antilatency markers. And precision seems great as well. Do You know if it's possible to create mocap suit ot of those ?
But now when I think about it, probably it is not a living room system. :D
That's great news! - It's very impressive how it works on zoom lens! Could you share some totally Hand-Held shoots?
I don’t have any handheld since all our cameras are hooked in tripods with all the cables. But I’ve tested it without recording and it’s real good! I also think my new lenses are really good without that much distortion which helps!
Hey, thank you for the great videos.
One question though. In the parts of this video where the green screen is visible, it seems as there is alot of green spill all over your body (sounds awful jeje). However when you cut to the virtual scene, the colors seems just natural. How do you achieve that? Thanks.
thanks!
"Anti-F^#KING-latency!!!!!" Only people in this game could get this excited by a tracking system upgrade.
Haha yes
my favorite part of the video
Do you think they could do a floor version where the tiles are chromakey green? Or do the lights still show through as not-green?
Hi Richard, great job, as usual. Thanks for sharing ! How big surface is covered with Antilatency IR in your studio?
8x9 meters.. thanks :)
Hi, Richard please share itemized details of the anti latency pieces that you used with your setup.
I hope you are getting the system for free, because you are selling it very well. Good job!
Haha! Actually not, I’m just glad it works!
Really great video! We are also working with the Antilatency trackers, but we haven't used Aximmetry before. Could you make an tutorial on how you set this up?
Nice!! Just watch my tutorial on vive and Aximmetry! It’s the same principle
@@richard.frantzen What can be a good computer system to work on Virtual reality for beginners..? Plz cover that too. Thanks!
Cool stuff Richard &. team! Thanks for the great tips. Recently we also started to look into alternative tracking solutions for HTC, this seems like a solid alternative for indie VP production. However do you feel like this it might become a problem if you have a lights truss on your studio ceilings?
Thank you 🙏 yes this is a problem. We are actually next week going to mount our trusspart that runs through the center of the space to see if it affects the tracking too much. I will get back to you with the results. Otherwise our plane is to mount lights where the trackers ain’t located
@@richard.frantzen Thanks, Thanks and Thanks for all the video's. One question about this topic. Our sealing is also full with lights. The floor setup is not an option for this? ( I have asked Antilatency as well but probably you have looked at this option. Painting the mats ones in a while is not appealing or even impossible ?!
Great video! Question: Do you use Aximmetry's broadcast version to do multimachine or you render each camera separately with a professional version?
I use Broadcast version on the master computer and professional om the other two! But i think studio would be enough on the other two as well
Hi Richard, I just purchased antilatency, i was wondering what u do about the genlock ?? Is it necessary for a good tracking like yours? If so do u use any other tech part apart the antilatency ? Ive made my eyes 4 to catch in your videos , for any parts regarding genlock in the setup ,,, any time i see your camera setup i try to pause it to see if is any parts im missing 😂😅
Great work Richard! Question, I have an Black magic design Ultimatte 12 keyer for realtime composites. can this work with your virtual sets and antilatency for tracking?
Yes absolutely!
hello, your videos are very good! what pc hardware do i need? (gpu cpu and ram)
Hi ,Richard I was looking for a tracking device in the UE4 and decided to buy a Vivetracker. So I want to ask how the Antilatency system has advantages and disadvantages. But very interesting this system Thank you very much, Richard
Rich thanks for covering camera tracking you're doing a great job ...Seems anti latency is the easiest solution for a small studio camera tracking system. I'm interested primarily because it seems to eliminate a lot of variables getting it working in Unreal. So between the HTC Vive and Anti latency - is Antilatency the best route as far as being a simple turn set up key -compared to Vive? ; I'm a one man team so I just cant get hung up trying to get Unreal and Vive working well together...
Yes! And get the floor mat kit to start with!
Great job! Thanks for the info! I wonder if you get clear image of your billboard talent ? I tried it and the talent looks very blurry.
I’m researching that. When in virtual camera mode I notice in some ways it gets blurry!
hi, what kind of camera are you using? 4k or 1080? would there be a difference in keying?
Thanks! It's it looks really great!
I'm puzzling by HTC VIVE drifting with aximmetry. I have 3 vive base station 2.0 and 2 trackers, I calibrate the aximmetry Origin parameter and Manuel Zoom, but at last, the drift still exist~
I wanna know, if it's possible to solve the vive drifting problem ? I doubt that.
The antilatency seems good enough, but in aximmetry forum, I found some posts about antilatency drifting problem, really? If antilatency drifting problem easy to solve?
This is just magic, I’m now inspired to buy everything I need to get my green screen studio to be able to produce this. You mentioned below you are using multi machine, is this set because you can only run 1 camera per machine? Is your Patreon page the best way to pick your brain? More than happy to use that if it means getting to this level of setup faster.
Yes multimachine because one computer per camera. I created a Patreon because so many people were asking about it and I figured I can use it for early access on tutorials, Patreon only content such as tools blueprints and other stuff, livestream etc. higher tier patron gets access to a secret discord forum where I will prioritize answering and hanging around.
Got a good question... How does Anti latency compare to Vanishing Point? ; It seems Vanishing point is just as easy to set up (and without the floor mats) - but VP seems to offer more options specifically geared towards camera work... All things considered, which one is going to be easiest/best to use with Unreal?
Love it.
I have but so many hours into Aximmetry and Unreal now, getting there step by step 🥳 But I wonder what cameras you are using with your Canon cn18-80 and cn70-200 ?
Are you using any auto focus or full manual mode?
I think he is using Blackmagic camera from looks of it.
woowww.....outstanding.... one question: did you use any device for genlock? or not necessary? let me know please... thank you
Thanks! No but I think Aximmetry does something under the hood! And what I hear others talk about is that Antilatency delivers the data in such a high speed that it isn’t needed. Don’t now about LED-screens though. But I know Antilatency recently shot something with LEDs so I guess it’s not a problem :)
Do have have masterclass for those totally new to such kind of production? Other than basic greenscreen production, I have no idea how such tracking virtual production works. Will be great if you offer masterclass for newbie like me.
Nice work there richard.. so it use marker on the top ceiling... So if we use led panel on ceiling can we use anti latency system
The trackers doesn’t take up every inch of the ceiling so my thought is to place lights where there are no trackers.
thats really awesome nice work Richard, by the way i've checked Antilatency before there price range is 25$ per meter this could be ok for small studio, but i'm dealing with over 400 meter square floor this could mount to $25,000 cost just for the ceiling markers if i'm correct
25 x 400 = 10 000 ?
Email them and ask, they were really helpful
@@richard.frantzen yes the current active studios is around 400m but the entire hall is much larger we relocated to a bigger place and its very challenging to rig it atm
@@richard.frantzen i will thank you
cool
The tracking looks good! What happens if you want to use a large butterfly in the roof. I guess its one limitation of that system? or is there any good workarounds?
Yeah thats kind of a problem! We use 60x60 leds that were going to out up on the empty tiles
Can you share your studio size width and length and depth also the high as well ? really appreciate for that 😀😀
Greetings from Indonesia, Richard... Thank you for sharing infos about this new tracking system. Is it obtainable internationally? Is there any detailed guidance regarding the installation when purchased?
They are really helpful! And we ordered it from Russia so shouldn’t be a problem!
Do you need the broadcast version of the Aximmetry to be able to use the glassmark encoder?
I’m not sure! That could be the case! Check with Aximmetry! I’m on Broadcast!
Great work as always! Can you tell me how much a system like yours with cost. I have a vive tracker and 2 base stations but haven’t been able to get it to track properly even after following your tutorials. So maybe this is an alternative as of the cost factor.
Kind of depends on your tracking needs , the active tracking markers cost about $25 per m² , and you need the tracking unit for $650 + the socket for $50 (UBS) / $70 for wireless
We're working with Antilatency and a vive tracker, but we have to recalibrate both at the start of each session, also we've got quite a fair amount of camera shake on both the Antilatency and Vive camera ._.
We're using unreal Engine instead of Aximmetry though, still wanted to ask if there's anybody who got some tipps for us 😅🖐
How many trackers does this support? Can you use this for body motion capture with say 5-10 on the body.
Thank you for sharing this. how do get a good result with the keyer in aximmetry
Great lighting is the answer :)
Hello there
Long time no see
Is it possible to make the subject have a reflection in the floor?
Welcher Version von aximmetry benötigt man um mit HTC vive zu tracken? If I go directly to UE4 with the tracking signal, as in a tutorial from you (th-cam.com/video/XWQZNw9iMNs/w-d-xo.html), then I have the problem that I cannot get the camera set correctly. The background does not match the foreground 100%. Do you have any tips? Thank you in advance.
my absolute excitement for this was killed by this terrible presentation. come on guys. awesome result in what it does so well done for that
Bruh, I'm passionate about your job. Great content! Could you give me your opinions about using only 1 htc vive tracker as a virtual camera for unreal engine? I'm going to start with a HTC vive Tracker and a greenscreen only, and my physical camera also
This is my exact scenario and yes the right thing to do is Getting a Vive Tracker and at least 1 base station with it to do Mixed reality contents. as @Richard Frantzen mentioned above u can get this gadget to get precise results with less effort.
Yeah up til now I’ve used vive tracker with four base stations and running the null driver help.triadsemi.com/en/articles/836917-steamvr-tracking-without-an-hmd
Without the headset
Thanks for the answers! I've always thought I could use HTC vive tracker alone, didn't know i needed to have the base station also. Imma research a bit more, keep up with the great content!
@@richard.frantzen So to use without the HMD we need to work it around as described in the link.? Is it not just plug them and detect via steamVR and go..? :-(
@@sinanarts yes! But skip the python part!
Thank you very much. I have successfully purchased a set of equipment through the purchasing channel you recommended last time.
Now I come across a problem, that is, how can I delay the tracking data in UE4?
Is this function in the official blueprint? Or do you need to write by yourself?
th-cam.com/video/R_lzJkINhvY/w-d-xo.html
To delay tracking, watch video at 01:40, you have the option 'Extrapolation Time' within the blueprint.
I hope this is what you are looking for.
@@tariq0513 Thank you very much!!
@@rolandtung1457 is Extrapolation Time working for the delay? I'm having the same issue too and looking for a way to delay the tracker and Extrapolation Time don't work for me.
not resolved problems with reflections. your shadow is very short, and your reflection is not on the glossy floor. how to fix it or improve there is a tip?
Great work!! The question is how much does it cost if I want to set it up in my home garage?
Yes! Sorry missed that totally! The system is modular so you have to Ask them for your specific setup. But about 100 IR-markers for our 10x10 meter tracking area and 5 WiFi trackers and 5 receivers cost us about 5-6 000 USD. You could get their dev kit for far less and then build on that!
@@richard.frantzen great. Thank you for the info!
Hi! What software/hardware do you use to do the chroma in real time? Thanks!
Hi Gemma! It's called Aximmetry! check it out at www.aximmetry.com
Thank you so much! So if I'm getting the floor edition no chance of using greenscreen on the floor? :/
You could use green mats but you’ll still see IR markers. One option is to use the floor just under the cameras and not on the green screen floor. I’ve heard you can use several “islands” under each camera and then connect them to the same “world”. But you need to check with Antilatency don’t take my word on it
@@richard.frantzen thank you so much for answering. I'm new to all this. I was certain that the mats are provided by them and saw only one color.
I actually entered their websites and saw so many parts, up to the point I wasn't sure what I actually need to get a good tracking like yours.
with ue5 i guess the graphic background would be more realistic. Please do share new shows
You looks cool 👌🏻 keep rockin
Thank you. 🍺🍺💪
Hello, can you please tell me if this was shot in 1080p or 4K on the Ursa G2? Thank you!!
1080 on Ursa G1
@@richard.frantzen thank you so much!
Do you have a video made for the kinds of equipments you need for a virtual production studio?
I touch it a bit in this video but maybe I could do a more in depth video! :)
Thanks!
Can't get on Anitlatency's website from here in the US. Must have to something to do with sanctions.
What about Vicon and Optitrack?
How much did the studio cost
What about genlock? As far as I know, ALT doesn't have sync support
wondering the same thing
Burn a VIVE Tracker 😂 For all of us, it was our first, but never our best.
HEY Richard, I want to do virtual production. For film and music videos. I have been trying for a long time, but something is going wrong somewhere. Can you guide me step by step? May want to use Aximmetry software for virtual production with Antilatency! I have a trial version of Aximmetry and Unreal engine for Aximmetry.
Please help me, from beginning to end...
*SYSTEM SPECS -
GPU - RTX 3090 MultiGPU
Capture card - DeckLink 4K Extreme 12G
RAM - 128 GB 3600Mhz
Processor - Threadripper 32core
Regards...
Very big studio Ask for a greenscreen, usually made of fabric or painted. Which is suitable for UE4 program. Thank you very much.
I would do painted!
@@richard.frantzen Thank you so much, I think too.
price ? cost? of your setup
looks like the price is not as good as you are saying. It's sketchy pricing plans and may be thousands of dollars. so sad :(
The tracking system really doesnt matter if the end result looks like this
Watch at 1.25 speed.👍
Biggest question unanswered : How much did you spend on this build?
Yes! Sorry missed that totally! The system is modular so you have to Ask them for your specific setup. But about 100 IR-markers for our 10x10 meter tracking area and 5 WiFi trackers and 5 receivers cost us about 5-6 000 USD. You could get their dev kit for far less and then build on that!
@@richard.frantzen is the dev kit still available? just googled it and the dev kit page doesnt have a buy button anywhere.
antilatency.com/getting-started/latest/prepare