This feels like what Film Riot has been about since day one. Taking tools that Hollywood productions use and putting them in the hands of indie creators. Keep pushing guys, this is looking sick!!!
I love how you guys don’t gatekeep any information! Resourceful! Like you guys really care about us filmmakers and want us to succeed in whatever we do 💕
Wow, I honestly could not tell that the background in the initial clip was CG. I actually thought for a second that it was just a clip from some big budget movie with a real environment. Absolutely amazing job. I have not been this impressed in a long time. Brilliant!
I was really impressed at first. The keyshot guy at work, after I showed him this, said: "Yeah mate, but there's a reason the subject isn't moving. The light wouldn't match the virtual environment if the subject moved around instead of how they just stood still." After hearing that, I watched it again. If you can get the subject to walk around in the environment and get your subject lighting to match the environment, I'll be REALLY impressed. I hit the like button anyway.
I've been researching this for a while because I have access to an LED wall and wanted to build a practical set around it. Everything I've read is the trackers are still not the best but what you have here in this video makes me think it's much further along than when I started my research for small productions. Thanks for posting this video as a great point of data for future projects.
Great to see the new HTC tracker in action. Looks pretty solid :). Focusing on the wall/projection looks so much better than trying to focus on a LED wall.
Ry! the speed of your progress is amazing brother. Keep it up man! I cant wait to see what you do with this. Unreal is super frustrating sometimes but its worth it! If all fails, like always blame it on Josh
Save the LiveLink settings as a profile once you’ve added the Mars and change the project settings to load it automatically on start up. nDisplay will then load it up with the profile you’ve saved activated.
Also check the switchboard and make sure your unicast endpoint ip is set correctly for the nDisplay node I.e. the ip address of the computer running nDisplay with a ‘:0’ at the end.
I just started learning Unreal. It's amazing to see how fast you have been picking this up. I feel like I'm still lost in the weeds, but videos like this keep me motivated!
Interested… more… yes. This plus the Unreal/Matrix collab on the same day is enough to overload a creative brain, in a positive way. My mind is blown 🤯
Great work man! That opening shot looked fantastic! I've been meaning to try out ndisplay myself but have only done tests the same way as you so far. Can't wait to see how it looks when you get it all figured out! For me the hardest part about working with a projector has been trying to light the subject without washing out the projection.
Thanks so much, I studied cinema but ended up working on live tv, now I'm trying to get on virtual production and want to help my fiend who is an indie filmmaker.
I'm at a similar stage using Unity, a quest 2 and a green screen. It's actually working, but its a bit of work. What I have done is mount the quest headset and the physical camera to a two handed grip, then set the headset as the virtual camera which films the virtual world - and the camera records the actor in the real world, these can then be stitched together (if using a green screen) or if projecting can run the virtual camera to the big screen in real time. The quest can airlink to any display or output source. I'm still yet to get fully operational but it does have potential to work a s a cheap diy of this type of solution
This is so cool! This is the future of small production! I hope this can eventually give people the means to make big budget looking stuff in their living room!
Great to see you joining the virtual production community. Through my experiments with back projection with Unreal it's perfectly viable but gets harder and harder the wider you want to shoot. Great for closeups and medium shots.
So I built this setup too after seeing this (latest video on my page) and definitely see awesome potential and application for it; it looks great. But one is definitely limited on the ambient lighting strength and the field of view. It kind of only really allows for portraits like in this video’s opening sequence. So here’s an idea … You know how you can use the nDisplay to connect multiple screens to make one larger screen? One could connect two Cinebeams - one on the floor, one upside down on the ceiling - and connect their projections to make one large surface that would allow full-body shots. Absolutely ridiculous idea but damn that would be great.
Love the show, been a fan since the beginning. It's great to see you all evolve with the new tech and I get to feel like I'm learning right along side. Thanks for showing your whole process, and making it OK to not know everything. Putting experimentation above all else is really cool. Thanks.
Nice to see you finality able to do this. I know you commented on my comment talking about this months ago. I really think as these short throw projectors get better and ue5 gets even more polished with plug-ins and such, this week be the future of filmmaking, replacing most uses for green screen. As a side note, you said you're figuring unreal out. Using quixel megascans, you can create super realistic outdoor scenes with drag and drop simplicity
This is amazing and just what I was looking for. Please stay on this and dial it in as user friendly as possible as this is the future of DIY filmmaking to be free of location issues and to let the imagination run wild for story ideas no longer chained to budget and location.
Exciting ! Thanks for sharing ! As Indie filmmaker , managed to get Alexa Classic few months ago and just now LG Cinebeam 85 LA is on a way in a week, will be trying to put this together soon... Very inspiring and crazy cool, insane ! Love your passion !
Speaking of corridor, film riot got a mention on their second Channel during a VFX review. A lot of the aspirational filmmakers who watched your channel regularly (including myself), but you guys inspired the people making cool stuff now. That is a cool retrospective.
The background looks so clean you'd never guess it's projected.. Probably the next level of this would be merging the real video of the background with the correct proportions and overlay it on the frame while keeping the person still in the frame( it's pretty easy these days with face / person detection ).
This is awesome, thanks for sharing this info. The close ups of the screen you did made it easier for me to understand, at least in that regard, how 4K projectors can compare to using LED tiles.
This may not be a tutorial but it is very educational as well as giving me a good idea of how much is put into it and I'm excited and can't wait to get my hands into this world of virtual production.
Amazing video! I have a small question. Do you project the video from the projector to a normal white wall or white photography background for example? Or do you use a special screen they made for such projectors so the projected image doesn’t get affected by lighting?
I think its normal projector screen that in white. The screen that u told about is "black daimond screen".its very expensive. Black daimond screen is in gray and silvery color.it hv the ability to reject the ambient light so that image will be in great contrast and saturation
You can see at 11:25 that they have a flag in front of the key light so there's no spill on the screen and the rest of the lights are facing away from it. As long as you're in a dark room to begin with, and keep lights directly off the background you should be fine - assuming you have a bright ass projector
Im more excited about the new htc tracker. It it works as good as the antilatency or mosys, it will instantly sell out. I hope we see something concrete from them soon. Thanks alot Ryan
I think if the issue you are facing is needing a seperate system to run the two plugins, I would suggest setting up a virtual machine with another copy of windows 10 and unreal engine running on it. This would atleast give you access to all the controls via one keyboard and mouse ( won't have to move between to physical computers) And it sounds like your system will be able to handle this kind of work!
I'm extremely excited when I see these videos, as Virtual Production at home feels insanely cool and inviting.. I do wonder how a budget setup might work since so many of these ideas require an expensive new projector (or else green-screening is an option that may defeat the benefits a little).
Well, I feel the video is probably more on showing what is possible and available more then what is budget friendly. Technically, a expensive projector is wayyyy cheaper then the alternative technologies that are starting to be used so it actually is a budget technique for small studios in the mean time(maybe not home studios).
I have almost exactly the same setup and it works with both live link and ndisplay. You just have to save your tracker preset and have the project set that preset as the default. Even if it’s not that I may be able to help I just went through all this for the film I’m shooting now. Feel free to reach out if you need more info.
Hi Guy's! Loving this Unreal thing you are taking us through... I was hesitant on learning one more thing, but I guess I'm going to jump in because it's to cool... Keep up the great work, and post everything you do "Unreal"
Not sure, but the problem might be a lack of genlock. You need a Quadro card, as far as I know a 3090 doesn't allow you to sync properly the virtual camera with the physical one, in terms of shutter and whatnot.
Would love to see more 3d and unreal stuff.. or even some stuff with Gaussian Splatting. I really miss the horror and funny shorts but since you seem to lean a lot more into the post side now - would be cool to see more 3d stuff.
I don't think they needed to. I think the virtual setting was always in focus, and the real camera had a good shallow lens to rack between the two. Just a guess
Great video man, ive been wanting to experiment this and seeing someone pick it up for the first time and being able to make it look like this is inspiring! One thing id like to add, i think you can add more realism in the shot if you use something for a hair light for when that window os light is directly behind her. Even mandalorian with their powerful led walls had to use external led lights configured to a dmx system of sorts. Good luck, and i hope to see more!
Next Step: making the focus of the digital camera synchronize with the real camera focus wheel XD Then you can make realistic focus pulls, even with scenes that have larger depth.
That was someting I was wondering about. If you could get lens/focus/aperture/camera data etc. to Unreal in real time, since it knows the position of the camera it should be able to simulate that in real time too.
Hi, great video! Did you have some kind of system to control focus simultaneously in Unreal and the physical camera? Or is it something you tweaked afterwards? Thank you!
Hey Ryan, I'm not sure if you've already covered it, but I was wondering if you could use the projector and green screen continuously. Maybe if you rented a warehouse on peerspace or something, and shot with the projector then ran out of frame to the greenscreen you could get more of that Mandalorian wide look...Depending on what you're shooting you might even be able to move the projector Infront of the greenscreen for a third shot and so on if needed.
While I only understood about 20% of the technical details, it's pretty freakin' cool. Hopefully in a few years this will be even more accessible and won't be so insanely complex to set up. I can dream at least.
Did you ever figure out the Switchboard issue? I'm using the Vive Mars Camtrack system and I can get the camera tracking to work in the Editor, but not when I launch it in Switchboard. Really confused as to why it doesn't work
This feels like what Film Riot has been about since day one. Taking tools that Hollywood productions use and putting them in the hands of indie creators. Keep pushing guys, this is looking sick!!!
I love how you guys don’t gatekeep any information! Resourceful! Like you guys really care about us filmmakers and want us to succeed in whatever we do 💕
Wow, I honestly could not tell that the background in the initial clip was CG. I actually thought for a second that it was just a clip from some big budget movie with a real environment. Absolutely amazing job. I have not been this impressed in a long time. Brilliant!
I can honestly say I had no clue it was a projector in the intro (I didn't read the full title lol)
I was really impressed at first. The keyshot guy at work, after I showed him this, said: "Yeah mate, but there's a reason the subject isn't moving. The light wouldn't match the virtual environment if the subject moved around instead of how they just stood still." After hearing that, I watched it again.
If you can get the subject to walk around in the environment and get your subject lighting to match the environment, I'll be REALLY impressed. I hit the like button anyway.
This feels like classic Film Riot, Ryan taking us along the journey as he learns something new great work !
I love that you guys are exploring this I know you will provide value
I've been researching this for a while because I have access to an LED wall and wanted to build a practical set around it. Everything I've read is the trackers are still not the best but what you have here in this video makes me think it's much further along than when I started my research for small productions. Thanks for posting this video as a great point of data for future projects.
Great to see the new HTC tracker in action. Looks pretty solid :). Focusing on the wall/projection looks so much better than trying to focus on a LED wall.
Speaking of focus, Ryan, how are you handing focus sync with this indie setup?
It's a lot of fun for sure. Still figuring things out, but super exciting!
it Sdi connection on camera nessery for this
Totally! Fantastic video showing that the Mars system is going to be a game changer!
Ry! the speed of your progress is amazing brother. Keep it up man! I cant wait to see what you do with this. Unreal is super frustrating sometimes but its worth it! If all fails, like always blame it on Josh
And that... is a bammy wham!
Yo
Save the LiveLink settings as a profile once you’ve added the Mars and change the project settings to load it automatically on start up. nDisplay will then load it up with the profile you’ve saved activated.
Also check the switchboard and make sure your unicast endpoint ip is set correctly for the nDisplay node I.e. the ip address of the computer running nDisplay with a ‘:0’ at the end.
I love that this isn't a full-blown tutorial, but more of a "check out this cool thing! Isn't filmmaking amazing?!" Man, filmmaking is so cool!!
I just started learning Unreal. It's amazing to see how fast you have been picking this up. I feel like I'm still lost in the weeds, but videos like this keep me motivated!
Interested… more… yes. This plus the Unreal/Matrix collab on the same day is enough to overload a creative brain, in a positive way. My mind is blown 🤯
Love the Unreal videos, keep em' coming! It's insane how good it's starting to look.
Really appreciate the honesty and humility in this. Great job !
Wow! So glad somebody tried this. I always assumed there would be sync issues with the background, like rolling or tearing, but this looks great.
Oh, how times has changed! This is awesome and definitely the future
Great work man! That opening shot looked fantastic! I've been meaning to try out ndisplay myself but have only done tests the same way as you so far. Can't wait to see how it looks when you get it all figured out! For me the hardest part about working with a projector has been trying to light the subject without washing out the projection.
I feel like ndisplay is such a pain, I am looking forward to this HTC device.
Thanks so much, I studied cinema but ended up working on live tv, now I'm trying to get on virtual production and want to help my fiend who is an indie filmmaker.
I'm at a similar stage using Unity, a quest 2 and a green screen. It's actually working, but its a bit of work. What I have done is mount the quest headset and the physical camera to a two handed grip, then set the headset as the virtual camera which films the virtual world - and the camera records the actor in the real world, these can then be stitched together (if using a green screen) or if projecting can run the virtual camera to the big screen in real time.
The quest can airlink to any display or output source. I'm still yet to get fully operational but it does have potential to work a s a cheap diy of this type of solution
This is unrelated but I bought a handful of assets on Black Friday from the Triune Store and it’s helped me so much.
Thanks guys.
I love series and where it's going! Been a fan for a long time and your videos are always amazing and entertaining
I want to learn this. This is the future of filmmaking.
This is so cool! This is the future of small production! I hope this can eventually give people the means to make big budget looking stuff in their living room!
Great to see you joining the virtual production community. Through my experiments with back projection with Unreal it's perfectly viable but gets harder and harder the wider you want to shoot. Great for closeups and medium shots.
So I built this setup too after seeing this (latest video on my page) and definitely see awesome potential and application for it; it looks great. But one is definitely limited on the ambient lighting strength and the field of view. It kind of only really allows for portraits like in this video’s opening sequence. So here’s an idea … You know how you can use the nDisplay to connect multiple screens to make one larger screen? One could connect two Cinebeams - one on the floor, one upside down on the ceiling - and connect their projections to make one large surface that would allow full-body shots. Absolutely ridiculous idea but damn that would be great.
Love the show, been a fan since the beginning. It's great to see you all evolve with the new tech and I get to feel like I'm learning right along side. Thanks for showing your whole process, and making it OK to not know everything. Putting experimentation above all else is really cool. Thanks.
Nice to see you finality able to do this. I know you commented on my comment talking about this months ago. I really think as these short throw projectors get better and ue5 gets even more polished with plug-ins and such, this week be the future of filmmaking, replacing most uses for green screen.
As a side note, you said you're figuring unreal out. Using quixel megascans, you can create super realistic outdoor scenes with drag and drop simplicity
This is amazing and just what I was looking for. Please stay on this and dial it in as user friendly as possible as this is the future of DIY filmmaking to be free of location issues and to let the imagination run wild for story ideas no longer chained to budget and location.
Exciting ! Thanks for sharing !
As Indie filmmaker , managed to get Alexa Classic few months ago and just now LG Cinebeam 85 LA is on a way in a week, will be trying to put this together soon...
Very inspiring and crazy cool, insane !
Love your passion !
Yay my tutorial mentioned on film riot, what an honour. You guys should try DMX lighting next.
as a starting point, it's mindblowing! great shit!
Man, I can't wait for the day that all this stuff is just laying in boxes misplaced in a bedroom office somewhere.
Speaking of corridor, film riot got a mention on their second Channel during a VFX review. A lot of the aspirational filmmakers who watched your channel regularly (including myself), but you guys inspired the people making cool stuff now. That is a cool retrospective.
The background looks so clean you'd never guess it's projected..
Probably the next level of this would be merging the real video of the background with the correct proportions and overlay it on the frame while keeping the person still in the frame( it's pretty easy these days with face / person detection ).
This is awesome, thanks for sharing this info. The close ups of the screen you did made it easier for me to understand, at least in that regard, how 4K projectors can compare to using LED tiles.
This may not be a tutorial but it is very educational as well as giving me a good idea of how much is put into it and I'm excited and can't wait to get my hands into this world of virtual production.
Amazing video! I have a small question. Do you project the video from the projector to a normal white wall or white photography background for example? Or do you use a special screen they made for such projectors so the projected image doesn’t get affected by lighting?
latter, first video explains it
I think its normal projector screen that in white. The screen that u told about is "black daimond screen".its very expensive. Black daimond screen is in gray and silvery color.it hv the ability to reject the ambient light so that image will be in great contrast and saturation
You can see at 11:25 that they have a flag in front of the key light so there's no spill on the screen and the rest of the lights are facing away from it. As long as you're in a dark room to begin with, and keep lights directly off the background you should be fine - assuming you have a bright ass projector
Also, at 1:52 they show it.
@@theegg2997 oh Thanks will check it out!
Keep the Virtual Production content coming. Thanks!
You all have always been so consistent! ive been watching since 2015! Keep up the great work...This tech Btw Is on a WHOLE nother Level lol
awesome guys, this is where video making is going now
This is WILD. I'll watch whatever progress videos you post on this.
Im more excited about the new htc tracker. It it works as good as the antilatency or mosys, it will instantly sell out. I hope we see something concrete from them soon. Thanks alot Ryan
I had Puget System build me a new editing monster. Love this beast.
This was awesome! Thank you for including us in your unreal learning journey.
Loving these Unreal videos. These are gonna be a huge help to a film I'm trying to make in the coming months. Thank you guys so much!
I think if the issue you are facing is needing a seperate system to run the two plugins, I would suggest setting up a virtual machine with another copy of windows 10 and unreal engine running on it.
This would atleast give you access to all the controls via one keyboard and mouse ( won't have to move between to physical computers)
And it sounds like your system will be able to handle this kind of work!
I have been waiting for more information on the new Vive system. It's on my list as soon as it comes out.
Yes! More of this unreal with live tracking stuff please! Good stuff.
Beautiful 🙌🏼
I'm extremely excited when I see these videos, as Virtual Production at home feels insanely cool and inviting.. I do wonder how a budget setup might work since so many of these ideas require an expensive new projector (or else green-screening is an option that may defeat the benefits a little).
Well, I feel the video is probably more on showing what is possible and available more then what is budget friendly. Technically, a expensive projector is wayyyy cheaper then the alternative technologies that are starting to be used so it actually is a budget technique for small studios in the mean time(maybe not home studios).
Very, very, very cool! Great video and I enjoy watching your progress!
I have almost exactly the same setup and it works with both live link and ndisplay. You just have to save your tracker preset and have the project set that preset as the default.
Even if it’s not that I may be able to help I just went through all this for the film I’m shooting now.
Feel free to reach out if you need more info.
wish i could try this out for myself, this looks so fun to work on ! insane what unreal can do 🔥
Amazing tech that is actually attainable!!
Amazing video !!
We are are doing similar things here at the University in Montreal thank for your Great presentation!
Great video big fan of the show I watch you every week keep up the good work 👍
this is amazing. It's nice to see an alternative to massively invasive tracking systems and an army of servers!
Men this is crazy I am loving it
So great stuff: thanks you Rioters! As usual: Only the best...
Hi Guy's! Loving this Unreal thing you are taking us through... I was hesitant on learning one more thing, but I guess I'm going to jump in because it's to cool... Keep up the great work, and post everything you do "Unreal"
That projector worked like a charm! Might have to try this...
Very awesome setup!!
OMG! This is great and I forgot about your channel. I bought one of your signed posters way back...
This is fudging awesome I love this stuff and can't wait to see a bunch of indies(your audience includeed) making amazing films with this
Absolutely amazing results. I totally said "Logo" after the sponsor segment. 🤣
I’m excited for the future of unreal engine. Filmmakers can make blockbuster type of films with a lower budget. You don’t need studio system anymore.
Thanks for all your help
This is Awesome!!! Yes, More on this and he HTC Mars
This is really fuckin cool. You guys have come such a long way, you all should be proud!
Not sure, but the problem might be a lack of genlock. You need a Quadro card, as far as I know a 3090 doesn't allow you to sync properly the virtual camera with the physical one, in terms of shutter and whatnot.
I love these unreal tuts.
appreciate it guys 😮
This look dope 🔥
Great job! Looking forward to more of this video! bravo!
Absolutely LOVE IT.
Nicely done. 😊
Love to know how you did the focus pull that reflects in the volume...
Would love to see more 3d and unreal stuff.. or even some stuff with Gaussian Splatting. I really miss the horror and funny shorts but since you seem to lean a lot more into the post side now - would be cool to see more 3d stuff.
4:03 yeah I'm interested! Thanks for the video!
AWESOME.. what camera track are you using?
That
Is
Insane
♥️ It!
OMG i would love to see that htc system and get to use it myself!!!!!!
Holy shit Ryan 😳 this is amazing
new HTC vive tracker is promising. FYI, you also can sync your set lighting to virtual lighting directly from unreal via DMX.
Great progress guys!!! One question though ☝️ . How did u manage to sync the real and virtual camera focus racking?
I don't think they needed to. I think the virtual setting was always in focus, and the real camera had a good shallow lens to rack between the two. Just a guess
Great video man, ive been wanting to experiment this and seeing someone pick it up for the first time and being able to make it look like this is inspiring! One thing id like to add, i think you can add more realism in the shot if you use something for a hair light for when that window os light is directly behind her. Even mandalorian with their powerful led walls had to use external led lights configured to a dmx system of sorts. Good luck, and i hope to see more!
I wish I had money for all of this cool gear and tech. I want to try it out so bad!!
Reminds me of early film Riot videos where we were going on the journey with you😂....this is awesome cant wait for next episode
Next Step: making the focus of the digital camera synchronize with the real camera focus wheel XD
Then you can make realistic focus pulls, even with scenes that have larger depth.
That was someting I was wondering about. If you could get lens/focus/aperture/camera data etc. to Unreal in real time, since it knows the position of the camera it should be able to simulate that in real time too.
There is a TH-cam video out there, in which they attach a vive tracker to the focus wheel and use that data in Unreal to do the focus pull
beautiful - would love to see your progress since :)
Hi, great video! Did you have some kind of system to control focus simultaneously in Unreal and the physical camera? Or is it something you tweaked afterwards? Thank you!
Awesome , so excited to follow this journey, keep up the good work and thanks :)
Thanks for posting this
This is really really cool!
Neat! Love working with Unreal for this stuff. Saved us during the lockdowns! :P
Hey Ryan,
I'm not sure if you've already covered it, but I was wondering if you could use the projector and green screen continuously.
Maybe if you rented a warehouse on peerspace or something, and shot with the projector then ran out of frame to the greenscreen you could get more of that Mandalorian wide look...Depending on what you're shooting you might even be able to move the projector Infront of the greenscreen for a third shot and so on if needed.
While I only understood about 20% of the technical details, it's pretty freakin' cool. Hopefully in a few years this will be even more accessible and won't be so insanely complex to set up. I can dream at least.
Did you ever figure out the Switchboard issue? I'm using the Vive Mars Camtrack system and I can get the camera tracking to work in the Editor, but not when I launch it in Switchboard. Really confused as to why it doesn't work