Chapters: 00:00 - Introduction to Virtual Production 01:03 - History of Virtual Production 03:46 - Chapter 1: How It Works 06:42 - Chapter 2: Built-In Lighting 09:50 - Chapter 3: Flexible Locations 13:46 - Takeaways
As an actor/writer/director myself, I love the real location more than anything just because it's an adventure in itself to engage with the real environment.
At the end of the day, this tech are just another tool to get the job done. I'd say if flim making wasn't mostly about making money and it was just for pure creative art, real location sets would be the go to for the most part. Unfortunately, we live in a world where everyone has to get paid for their time and make a living off of from flim making. Lol.
The Footage, the production, the montage, the topics... BREATHTAKING! Thank you very much dear Studiobinder Team for constantly providing us with such detailed and high qualitative content! Keep up the good work! Much love to you all and everyone reading this comment. May you achieve anything you envision!
I think Virtual Production will lead to better stories too. It requires much more pre-production work, which means directors must have clear intention BEFORE they start filming. So many of today's films are shot on a green screen without a clear idea of what the scene is going to look like. "Doesn't matter. We'll fix it in Post." CGI artists and editors are left polishing a turd; the former often getting blamed for a movie's failure at the box-office.
Thats not at all how it works. Green screen is planned to absolute details. They have a pre viz so detailed that it could stand as an animation on its own. Vfx supervisors are also on set to make sure everything is set up propperly.
Unfortunately a hefty amount of the time we still have to change the background in virtual production situations. LED screens have made it a lot more difficult and time consuming in that regard. Especially with edge corrections.
this Virtual Production is absolutely going to lead to some huge revolutions in filmmaking and I'm excited to see how it develops. Definitely not the end of the green screen, since it has the lighting and flexibility of post-production issues, but certainly a powerful tool in the right film crew's hands.
My husband recently did a virtual production project. I don’t know a ton about it but I do know he REALLY enjoyed working on it. Can’t wait for it to be released!
What I like about virtual production is the realism it brings whenever the audience is watching and that it feels like the actors are actually in a setting when in reality they are on a stage!!
That tech is outstanding. It's so much more realistic. The old rear projection looked bad on our old CRT TV screen when I was a kid, eh hem years ago lol, and it's just as bad on my small tablet screen. But the new tech - wow! Thank you for explaining it so well. I'd heard bits about it but now I feel more like I can thoroughly appreciate it.
Virtual production is basically a combination of practical effects and special effects. I love how they came up with this idea. The scenes looks more realistic. With this innovation, the actors are not anymore limited as to what colors they should wear or not, which is a major problem in using a green screen/blue screen/chroma keying.
The main problem is the space constraints. The volume, as they call it, will probably never replace a well done and lit blue/green screen. The sets in the Mandalorian feel fake, restricted and flat. Everything is at ground level. When you get accustomed to it you can clearly see the rounded background wall.
James Cameron has a history of innovation and development that places him at the forefront of people who have pushed the industry forward. He has never allowed himself to be constrained by existing technology. It will be, perhaps, his greatest legacy.
The possibilities and the time and money savings are huge! You don't have to get a location permit, stop or monitor traffic, deal with delays due to wrong weather conditions. The list goes on and on😉
Sounds cool for the future! Currently for most productions LED screen virtual production is more expensive than other methods, but with wider adoption I'm sure this will change! Though if you have to film with children or in many different changing environments there are situations where it becomes cheaper! Crazy world we live in
VP is an amazing tool for filmmakers to create an environment that's hard to find or go irl. For eg, I have to find a certain apartment that has 2 blocks facing each other with a certain kind of color in a certain kind of place or hue or whatever, VP will make this process faster by removing the process of location scouting and helps us to save our time and money. There's so much more VP provides like it removes the unnecessary noises that you can find when you are shooting outdoors like the cars and whatever since you are shooting on set. I wish this technology will be more accessible for all filmmakers cuz it helps so much
Pretty impressive that turn-key virtual sets for amateur filmmakers are available (starting at) under $10,000. Pretty cool. I heard that the "Volume" used by Lucasfilm costed about 20 million dollars to create...
Definitely the future of film making. Challenges that need to overcome are the ability of the camera movements and creating realistic imagery that can look very real. One step and technical advancement at a time.
Personally, I love the idea of vp. As an amateur filmmaker with a rediculously low budget, I really like the idea of framing an lcd screen for a window shot.
Virtual production is the future of shooting a film and the use of it will revolutionize the way we make films thanks to constant technological updates and innovations!!
I think when it comes to stylized or what would be insane budget locations, VP is an amazing tool for allowing the cast and crew to visualize the scene, rather than having to imagine it. Though, I also believe that shooting in actual locations are the most realistic option if available. Plus, it's always fun to scout out locations.
Seeing these compilations makes the limitations more apparent. Lots of closer shots, and like they mentioned, limited movement. Feels like a set, moves like a set, is a set.
Thank you very much for all the explanation. I had to read on Virtual pRoduction in Production Pipeline Fundamentals and I had a hard time visualizing what it really was. Very good video and informations on the subject
It looks like a very valuable tool with significant plusses. But I don't see it completely replacing outdoor shots (at least for awhile), for some of the reasons mentioned (difficulty emulating direct sunlight, limited space on a soundstage, limited camera movement, etc). Still, there's no reason you couldn't mix and match to get whatever your production needs. I'd love to play with it... :)
We are working with VP a lot now in natural history shoots, it's been fantastic and is becoming quite the norm now, both with LED screens but also by using the unreal on a Terrace high res tv screen. Definitely feel that this is the future or at least another tool for us to use.
Using Unreal now, and the only other I'm aware of, altho it's back to green screen, is Blender. I think Unity is moving in that direction, too, after they bought Weta, but Unreal is lraps and bounds in first place.
There are other programs that can create 3D elements in the shot, but Unreal Engine is really the only thing people are using for virtual production like we showed here
Definitely! One of the main issues is that LED walls only look convincing in certain lighting situations. We currently have no proposed solution to a variety of lighting situations like having large light sources like the sun look as realistic on an LED stage as opposed to other filming conditions.
@@hglankshear Yes, and nobody is talking about it! No high speed shots also. LED entry level price tag is 100% more vs green screen. Background always has to be out of focus. You cannot pull the focus on the LED wall itself. No post prod is true, but time required to prepare the environments is quite substantial.... Not to mention that you can catch moire effect and then post production is required...
This was very informative. I think it’s a great new discovery. As an actor that would help me greatly so I would have to use my imagination to see what’s going on, but I could see where I am and what I’m looking at would make it easier to let go and let my emotions flow easier. This is fascinating and I think it’s something that’s not gonna take over completely meaning we will still use locations and we would use this new technique. It’s wonderful that we can combine do with old. Again, thank you for this informative video.
I actually use Unity engine to create a virtual set, where I place my actors from 2D planes. One issue in the mentioned LED screens is that is more expensive to get than a huge green screen room, but later you pay it on the post compositing. All of this is quite fascinating. Just remember that in most big budget films, like DUNE they construct real sets for a lot of scenes. One huge difference on having a surrounding huge LED screen is that the reflections are cast on the actor, while in mine, its limited as it is a 2D plane. My actor do cast shadow and reflection, but its a plane, it lacks the volume.
The first time someone put up a green screen and said, "We'll add that part in post," it completely changed film production. We've been living in that world for over 40 years, an entire career for some our colleagues in this industry. The interesting part in the craft of virtual production is that it's conceptually a return to Old Hollywood shooting, where all shots just had to be planned out with creative solutions beforehand and then entirely and practically actualized on set. Then we just edit, color, sound and deliver. With tools like simulcam, LEDs, XR, etc., we are conceptually moving more towards WYSIWYG shooting, so workflow stages like digital assets need to shift way earlier while previz and techviz need to be far more rigorous and accurate. It seems appropriate that the most notable VP example is still a Star Wars series, considering the original three movies pushed practical effects to new frontiers in the 70's and 80's, while the prequels did the same for green screen in the 00's.
Like WOW!!! To see it in context, this is great!!! I would like to see more about virtual production, specifically if you can upload a virtual Unreal environment, can you upload a B-Roll environment? Do you need a 3-D aspect or will 2-D work the same? So like walking down a city street and you film it with a camera, could that be uploaded or would this have to be created in Unreal to simulate the street? Whatever the answer, this look into the virtual production is both fascinating and daunting. I feel overwhelmed as a novice filmmaker to learn and master one more technique but also intrigued to learn it. As Ben Kenobi said in "A New Hope", "You have taken a step into a larger realm." Thanks for the video!!!
To upload the video to unreal you would have to use photogrammarty and lidar to convert the video to a 3d mesh. LED walls monitor the position of the camera and change the what is shown in the background accordingly to get accurate parallax. So unless you are planning your shots in accordance with the angle of the video you've taken, this wouldn't be possible without building a 3d environment of some sort.
Amazing video, thank you for putting it all together. I would be lying if I didn't mention its a bit overwhelming. Its so difficult to keep up with everything changing in the world of filmmaking.
It must be amazing to work with led screens, but is important that directors don't get too accommodated with that like some did with green screen, because although is more realistic most of the time, the limitations like space and sunlight can still ruin a good scene. Not to say you need to plan everything very carefully cause is harder to "fix in post" if necessary. Also, filming in the real world and with real built sets might be a lot more expensive and bureaucratic, but is always more fun and adventurous.
"Live-keying" is also a type of virtual production. You don't always need LED walls to create a live recording with a final output, while LED walls make the image look better because of the lighting it's still a lot more expensive than a simple green screen. The cheapest virtual production method is live-keying, using softwares like Aximmetry will give you a really good key as well.
its interesting to see the use of this technology vs green screen vs shooting in real places. also the combination of the unreal engine and nanite are truly on another level, some people are fricking hard working geniuses. i would assume this also makes the filming time and costs much easier, and also might make it easier for actors as youve mentioned in the video. just a follow up question, do you know who invented this?
I don't think the concept of VP was created by one person as it involved prior tech like Unreal Engine and LED screens. But The Mandalorian seems to be one of the first mainstream projects that put the whole thing together
As of the current situation for most productions switching to VP is not cheaper. However, for the productions that have been using it so far have a unique set of circumstances that make it cheaper.
'its a diffuse light because of the distance'; is this because of the limited contrast ratio you can produce in the medium/ at the distance? and the fact that its probably not perfectly matte, so its reflecting light back?
We are creating a kind of hybrid VP technique. The lighting and reflections of LED walls but it appears three dimensional to everyone on set yet has the flexibility of relighting and comp, if need be in post. VP, as it is done now, will evolve to not require as much preproduction time. It will need to in order to become more widely used.
While there is an upside to this, it also locks complex issues of visual effects into a shot. Everything has to be figured out and prepared ahead of time, with priction, first unit intense deadlines. While that is normal for physical sets that might get by with some parts not being done, for these CG sets, anything not done may turn into a bigger problem. The visual effects pipeline, occurring before production (rather than in post), is a huge change, and it also prevents directors from changing VFX later in post. That has advantages and disadvantages.
Not quite. Every part of the background that has no real element in front of it can trivially be replaced. The camera is tracked, so changing the model and re-rendering the camera's view, then roughly cutting out the actors, is trivial. The seam between the camera picture and the rendered picture is quite small, basically just the errors introduced by the real-world screen not being exactly where the computer thinks it is and the real lens not being perfect.
@@HenryLoenwind What you describe is exactly what virtual sets are supposed to avoid: camera tracking and new VFX in post. The goal is to get the shot in camera, otherwise this is like any VFX shot through traditional post methods. That is the promise sold to studios and directors, that they don't have to do this. It isn't previz, it is finalled in the camera.
Man! Kudos for your hard work and kindly watch “Dasara” movie by Srikanth Odela it’s a Indian Film(Telugu language) 🇮🇳 for sure it’s a fest for movie lover we’re waiting for yours explanation and breakdown love from India ❤
i want to be a part of the film industry! i’d love working on a set. even if i was just doing mindless physical work not making much i’d still be happy
I think the biggest strength of VP is the fix of eye line problem, you're supposed to look at "something" on green screen so.. where is it? Also I think it's good for a natural low-light scene, since you have limited time to shoot at dawn/dusk or difficult lighting in low light area in real location.
On the one hand, it is amazing what this technology can do. On the other hand, there is something about a real location with all the imperfections that seems more real and believable. If they made Lawrence of Arabia with this I don't think the movie would feel the same... There is a sense in many CGI heavy movies of fakeness. It looks unreal and it can take you out of the experience. But this saves time and money and yet a true sense of place is lost.
Yes, they record the actual LED screen. And there is also the option to comp it manually by putting a small patch of green behind the subject. That way you get the wraparound lighting and virtually zero spill.
@@ifell3 Yes, it technically is OLED since all the pixels are small, individual LED lights. The pixels usually also have some diffusion lenses in front of them to disperse the light a bit better and reduce the visiblility of the pixel grid. Edit: The lenses also are the key to make the individual panels have edge to edge picture so no bezels whatsoever. The panels themselves are usually about 30x30cm / 1x1ft in size.
![Post-Production Explained - Each Step of the Post-Production Process [Stages of Filmmaking, Ep 4]](http://i.ytimg.com/vi/qKPHNWEV5_o/mqdefault.jpg)
Chapters:
00:00 - Introduction to Virtual Production
01:03 - History of Virtual Production
03:46 - Chapter 1: How It Works
06:42 - Chapter 2: Built-In Lighting
09:50 - Chapter 3: Flexible Locations
13:46 - Takeaways
I studied filmmaking in a university, but I learn filmmaking from StudioBinder.
🔥🔥
Did you find university worth the investment?
@@chrisdickersonfilms The first year, yes. The rest? Not so much...
As an actor/writer/director myself, I love the real location more than anything just because it's an adventure in itself to engage with the real environment.
For sure, after all VP is great because it gets us closer to the real environment
That's awesome! How many movies have you made?
True. But sometimes, when a real location isn't an option, this looks like a great alternative.
Thank you for saying this. As an amateur photographer and very new to filmmaking, I love being in a location. It's a character in itself
At the end of the day, this tech are just another tool to get the job done.
I'd say if flim making wasn't mostly about making money and it was just for pure creative art, real location sets would be the go to for the most part.
Unfortunately, we live in a world where everyone has to get paid for their time and make a living off of from flim making. Lol.
The Footage, the production, the montage, the topics... BREATHTAKING! Thank you very much dear Studiobinder Team for constantly providing us with such detailed and high qualitative content! Keep up the good work! Much love to you all and everyone reading this comment. May you achieve anything you envision!
Thanks for watching!
The natural lights and reflections from the led screens are really nice, also how the environment can be updated in real time.
*LED*
so helpful to filmmakers
Absolutely. Seems to take the guess work out of lighting which seems more efficient, cost effective, and promotes better time management.
StudioBinder is literally like Film school except in forms of informative videos that go really in-depth and show the process of filmmaking!!
That's the idea!
I think Virtual Production will lead to better stories too. It requires much more pre-production work, which means directors must have clear intention BEFORE they start filming.
So many of today's films are shot on a green screen without a clear idea of what the scene is going to look like. "Doesn't matter. We'll fix it in Post." CGI artists and editors are left polishing a turd; the former often getting blamed for a movie's failure at the box-office.
Good point!
Thats not at all how it works. Green screen is planned to absolute details. They have a pre viz so detailed that it could stand as an animation on its own. Vfx supervisors are also on set to make sure everything is set up propperly.
Hahahaha polishing a turd 😂😂😂
Unfortunately a hefty amount of the time we still have to change the background in virtual production situations. LED screens have made it a lot more difficult and time consuming in that regard. Especially with edge corrections.
Are CGI artists required to adjust the imagery on set while shooting ?@@hglankshear
My favorite new invention in film production, it’s really exciting to be around in such a important change to the whole industry.
truly a game-changer!
this Virtual Production is absolutely going to lead to some huge revolutions in filmmaking and I'm excited to see how it develops. Definitely not the end of the green screen, since it has the lighting and flexibility of post-production issues, but certainly a powerful tool in the right film crew's hands.
Can't wait to see what more filmmakers will do with it
My husband recently did a virtual production project. I don’t know a ton about it but I do know he REALLY enjoyed working on it. Can’t wait for it to be released!
Congrats!
If I"m gasping it's because this just took my breath away. Oh the possibilities. Bravo StudioBinder! With love from Atlanta.
The Mandolorian’s epic set pieces are really a step forward in immersive sci-fi
Hopefully more shows will follow
Really really excited to see where it goes. Only 10 years and it's already staggeringly marvelous.
What I like about virtual production is the realism it brings whenever the audience is watching and that it feels like the actors are actually in a setting when in reality they are on a stage!!
Cool!
That tech is outstanding. It's so much more realistic. The old rear projection looked bad on our old CRT TV screen when I was a kid, eh hem years ago lol, and it's just as bad on my small tablet screen. But the new tech - wow!
Thank you for explaining it so well. I'd heard bits about it but now I feel more like I can thoroughly appreciate it.
Happy to :)
Virtual production is basically a combination of practical effects and special effects. I love how they came up with this idea. The scenes looks more realistic. With this innovation, the actors are not anymore limited as to what colors they should wear or not, which is a major problem in using a green screen/blue screen/chroma keying.
Loved how they used a clip from 'Thor: Love and Thunder' - I was on that set! Seeing the background shift to create parallax was trippy! 😂
Amazing!
The mandalorian was the first series at least to ever use back ground TV led screens than green, and it was absolutely game changing
one of many great things about the show
@@StudioBinder yup it was revolutionary for the time
The main problem is the space constraints. The volume, as they call it, will probably never replace a well done and lit blue/green screen. The sets in the Mandalorian feel fake, restricted and flat. Everything is at ground level. When you get accustomed to it you can clearly see the rounded background wall.
@@r.c.c.10 Agreed, also films like 300 or Sin City could never be made like that, only by blue/green screen.
I know from a reliable source that every single VP shot on the mandalorian was rotoscoped and replaced with CGI backgrounds.
James Cameron has a history of innovation and development that places him at the forefront of people who have pushed the industry forward. He has never allowed himself to be constrained by existing technology. It will be, perhaps, his greatest legacy.
Agreed!
The possibilities and the time and money savings are huge! You don't have to get a location permit, stop or monitor traffic, deal with delays due to wrong weather conditions. The list goes on and on😉
Hopefully it'll promote more mid-budget films
Sounds cool for the future! Currently for most productions LED screen virtual production is more expensive than other methods, but with wider adoption I'm sure this will change! Though if you have to film with children or in many different changing environments there are situations where it becomes cheaper! Crazy world we live in
This actually reminds me of the screen they put up in MIssion Impossible 4 in the hallway in Russia. That idea was ahead of its time.
Great point!
This is the best explanation of the virtual LED wall I've seen yet. Thanks.
Been waiting for this. Thank you for the awesome explanation.
Thanks for watching!
This channel is my film school! So insightful and covers everything you need to know. Thank you StudioBinder
Thanks for watching!
Welcome back!! Not saying the other voice over guy was bad, but just missed the accent!
We work with multiple narrators!
VP is an amazing tool for filmmakers to create an environment that's hard to find or go irl. For eg, I have to find a certain apartment that has 2 blocks facing each other with a certain kind of color in a certain kind of place or hue or whatever, VP will make this process faster by removing the process of location scouting and helps us to save our time and money. There's so much more VP provides like it removes the unnecessary noises that you can find when you are shooting outdoors like the cars and whatever since you are shooting on set. I wish this technology will be more accessible for all filmmakers cuz it helps so much
all great points!
Honestly, this sounds like a blast to use. I'd just be stoked to stand in the middle of one of these sets.
It's awesome!
Pretty impressive that turn-key virtual sets for amateur filmmakers are available (starting at) under $10,000. Pretty cool. I heard that the "Volume" used by Lucasfilm costed about 20 million dollars to create...
Will love to see what indie filmmakers produce with this tech in their hands
@@StudioBinder Indeed!
Spectacular!
Thank you StudioBinder for this Inspiring video.
Glad you liked it!
Definitely the future of film making. Challenges that need to overcome are the ability of the camera movements and creating realistic imagery that can look very real. One step and technical advancement at a time.
Excited for the future
Such a clear explanation. Great job. Also, a cheaper alternative is rear projection instead of led screens but its dimmer with lesser light falloff.
Personally, I love the idea of vp. As an amateur filmmaker with a rediculously low budget, I really like the idea of framing an lcd screen for a window shot.
It would be a worthwhile investment
VP has arrived at the right time to meet the insatiable appetite for streaming content.
Studio Binder never misses 🙌
Cheers!
I always learn so much from StudioBinder videos. Thank you so much!
Virtual production is the future of shooting a film and the use of it will revolutionize the way we make films thanks to constant technological updates and innovations!!
We'll see!
Glad to have our suave Englishman back for the voiceover.
✔✔
This is one of the best channels ever .
The O.G voice is back!!!!🔥
👍👍
I think when it comes to stylized or what would be insane budget locations, VP is an amazing tool for allowing the cast and crew to visualize the scene, rather than having to imagine it. Though, I also believe that shooting in actual locations are the most realistic option if available. Plus, it's always fun to scout out locations.
Seeing these compilations makes the limitations more apparent. Lots of closer shots, and like they mentioned, limited movement. Feels like a set, moves like a set, is a set.
This is indeed the future. Thank you always studiobinder
Absolutely Fantastic! Verily the future of filmmaking. My producer sent me this video, and I'm definitely in.
now i understand why those high priced screens are for, love every episode of "what is" ♥
Thanks for watching!
I made it mom ! I'm in the video ❤
This is very interesting and an improvement on green screen but location films are still much more interesting.
Thank you very much for all the explanation. I had to read on Virtual pRoduction in Production Pipeline Fundamentals and I had a hard time visualizing what it really was.
Very good video and informations on the subject
It looks like a very valuable tool with significant plusses. But I don't see it completely replacing outdoor shots (at least for awhile), for some of the reasons mentioned (difficulty emulating direct sunlight, limited space on a soundstage, limited camera movement, etc). Still, there's no reason you couldn't mix and match to get whatever your production needs. I'd love to play with it... :)
It'll never replace real locations, we were comparing it to other techniques that simulate environments like green screen
@@StudioBinder Right, that was the feeling I got. It certainly has its place, and the tech will only get better. It's a cool option to have... :)
This is very interesting and the editing makes it more enjoying! Great job!
Glad you liked it!
We are working with VP a lot now in natural history shoots, it's been fantastic and is becoming quite the norm now, both with LED screens but also by using the unreal on a Terrace high res tv screen. Definitely feel that this is the future or at least another tool for us to use.
Unreal Engine is really powerful, which other 3D software is good for vp? Perfect video as usual, thank you SB team!
Using Unreal now, and the only other I'm aware of, altho it's back to green screen, is Blender. I think Unity is moving in that direction, too, after they bought Weta, but Unreal is lraps and bounds in first place.
@@3dchick wow didn't know they bought weta, that could yield really interesting results! Thank you for the insight!
@@MagneticDonut You're welcome. I want to say it was about a year ago. ☺️
There are other programs that can create 3D elements in the shot, but Unreal Engine is really the only thing people are using for virtual production like we showed here
Absolutely BRILLIANT explanatory video! WELL DONE!!
This is a great video! I learnt a lot of things! Thanks for sharing!
Thanks for watching!
Do you know how much I have waited for this episode
Hope it was worth the wait!
Very interesting as always. Thank you StudioBinder : )
Cheers!
Green screen isn't going to end, but will probably used for smaller productions and some specific kind of scenes.
Time will tell!
A film like 300 could never be made without green screen, neither Speed Racer or Sin City.
Definitely! One of the main issues is that LED walls only look convincing in certain lighting situations. We currently have no proposed solution to a variety of lighting situations like having large light sources like the sun look as realistic on an LED stage as opposed to other filming conditions.
@@hglankshear Yes, and nobody is talking about it! No high speed shots also. LED entry level price tag is 100% more vs green screen. Background always has to be out of focus. You cannot pull the focus on the LED wall itself. No post prod is true, but time required to prepare the environments is quite substantial.... Not to mention that you can catch moire effect and then post production is required...
Absolutely stunning and revolutionary!
This was very informative. I think it’s a great new discovery. As an actor that would help me greatly so I would have to use my imagination to see what’s going on, but I could see where I am and what I’m looking at would make it easier to let go and let my emotions flow easier. This is fascinating and I think it’s something that’s not gonna take over completely meaning we will still use locations and we would use this new technique. It’s wonderful that we can combine do with old. Again, thank you for this informative video.
Wait, do a video on the availability of virtual production sets made to order, that sounded amazing.
This the new one invention and I have already loved it
It's making waves for sure!
I actually use Unity engine to create a virtual set, where I place my actors from 2D planes. One issue in the mentioned LED screens is that is more expensive to get than a huge green screen room, but later you pay it on the post compositing. All of this is quite fascinating. Just remember that in most big budget films, like DUNE they construct real sets for a lot of scenes. One huge difference on having a surrounding huge LED screen is that the reflections are cast on the actor, while in mine, its limited as it is a 2D plane. My actor do cast shadow and reflection, but its a plane, it lacks the volume.
The first time someone put up a green screen and said, "We'll add that part in post," it completely changed film production. We've been living in that world for over 40 years, an entire career for some our colleagues in this industry. The interesting part in the craft of virtual production is that it's conceptually a return to Old Hollywood shooting, where all shots just had to be planned out with creative solutions beforehand and then entirely and practically actualized on set. Then we just edit, color, sound and deliver. With tools like simulcam, LEDs, XR, etc., we are conceptually moving more towards WYSIWYG shooting, so workflow stages like digital assets need to shift way earlier while previz and techviz need to be far more rigorous and accurate.
It seems appropriate that the most notable VP example is still a Star Wars series, considering the original three movies pushed practical effects to new frontiers in the 70's and 80's, while the prequels did the same for green screen in the 00's.
Like WOW!!! To see it in context, this is great!!! I would like to see more about virtual production, specifically if you can upload a virtual Unreal environment, can you upload a B-Roll environment? Do you need a 3-D aspect or will 2-D work the same? So like walking down a city street and you film it with a camera, could that be uploaded or would this have to be created in Unreal to simulate the street? Whatever the answer, this look into the virtual production is both fascinating and daunting. I feel overwhelmed as a novice filmmaker to learn and master one more technique but also intrigued to learn it. As Ben Kenobi said in "A New Hope", "You have taken a step into a larger realm." Thanks for the video!!!
Thanks for watching!
To upload the video to unreal you would have to use photogrammarty and lidar to convert the video to a 3d mesh. LED walls monitor the position of the camera and change the what is shown in the background accordingly to get accurate parallax. So unless you are planning your shots in accordance with the angle of the video you've taken, this wouldn't be possible without building a 3d environment of some sort.
Amazing video, thank you for putting it all together. I would be lying if I didn't mention its a bit overwhelming. Its so difficult to keep up with everything changing in the world of filmmaking.
This tech is probably best advancement for many flim makers and especially, actors who just don't like green or blue screen acting.
It must be amazing to work with led screens, but is important that directors don't get too accommodated with that like some did with green screen, because although is more realistic most of the time, the limitations like space and sunlight can still ruin a good scene. Not to say you need to plan everything very carefully cause is harder to "fix in post" if necessary. Also, filming in the real world and with real built sets might be a lot more expensive and bureaucratic, but is always more fun and adventurous.
I love the voice behind this video
Virtually the best channel on TH-cam 😏😏😏😏😏
Virtually and practically we hope haha
Lubezki used a less sophisticated Volume in Gravity, 'The Light Box', to match the lighting from the cgi sun and stars in the actors faces
It was well done!
"Live-keying" is also a type of virtual production. You don't always need LED walls to create a live recording with a final output, while LED walls make the image look better because of the lighting it's still a lot more expensive than a simple green screen. The cheapest virtual production method is live-keying, using softwares like Aximmetry will give you a really good key as well.
Crazy that the Wizard of Oz tornado scene is not mentioned despite being just that! Most realistic tornado shots in movie history!
Very well explained topic with clear concept 👏👌👍
its interesting to see the use of this technology vs green screen vs shooting in real places.
also the combination of the unreal engine and nanite are truly on another level, some people are fricking hard working geniuses.
i would assume this also makes the filming time and costs much easier, and also might make it easier for actors as youve mentioned in the video.
just a follow up question, do you know who invented this?
I don't think the concept of VP was created by one person as it involved prior tech like Unreal Engine and LED screens. But The Mandalorian seems to be one of the first mainstream projects that put the whole thing together
As of the current situation for most productions switching to VP is not cheaper. However, for the productions that have been using it so far have a unique set of circumstances that make it cheaper.
Amazing.. recently was read the article of Media Monk agency regarding this subject
I can’t wait to get into Hollywood film production
I am eagerly waiting this to arrive in Indian Film Industry. So, we can experience it.
Excited to see what you guys do with it!
The Mandalorian really changed the game for the movie and tv shows going forward! This is the way.
'its a diffuse light because of the distance'; is this because of the limited contrast ratio you can produce in the medium/ at the distance? and the fact that its probably not perfectly matte, so its reflecting light back?
I was not prepared for that opening
😅
I can’t believe you guys used “The Room” in this edit 😂
Had to use a classic
We are creating a kind of hybrid VP technique. The lighting and reflections of LED walls but it appears three dimensional to everyone on set yet has the flexibility of relighting and comp, if need be in post.
VP, as it is done now, will evolve to not require as much preproduction time. It will need to in order to become more widely used.
Can't wait!
Like always, the future of filmmaking will be a combination of both new and old ideas, techniques and technologies.
The evolution continues!
LOved watching this!
Great to hear!
While there is an upside to this, it also locks complex issues of visual effects into a shot. Everything has to be figured out and prepared ahead of time, with priction, first unit intense deadlines.
While that is normal for physical sets that might get by with some parts not being done, for these CG sets, anything not done may turn into a bigger problem. The visual effects pipeline, occurring before production (rather than in post), is a huge change, and it also prevents directors from changing VFX later in post. That has advantages and disadvantages.
Not quite. Every part of the background that has no real element in front of it can trivially be replaced. The camera is tracked, so changing the model and re-rendering the camera's view, then roughly cutting out the actors, is trivial. The seam between the camera picture and the rendered picture is quite small, basically just the errors introduced by the real-world screen not being exactly where the computer thinks it is and the real lens not being perfect.
@@HenryLoenwind What you describe is exactly what virtual sets are supposed to avoid: camera tracking and new VFX in post. The goal is to get the shot in camera, otherwise this is like any VFX shot through traditional post methods. That is the promise sold to studios and directors, that they don't have to do this. It isn't previz, it is finalled in the camera.
I love when they use The Room as an example 😂
It's a classic
lol I loved the Dirk Diggler scene at the end.
Man! Kudos for your hard work and kindly watch “Dasara” movie by Srikanth Odela it’s a Indian Film(Telugu language) 🇮🇳 for sure it’s a fest for movie lover we’re waiting for yours explanation and breakdown love from India ❤
thanks for the suggestion!
Very instructive. Thanks! 👍
Cheers!
Saw it utilized in The Batman, it was handy during COVID quarantine
You guys are the best !!
This was my thesis topic thanks a lot helped me very much .😎💯👽⚔️⚔️⚔️
Is it possible to learn about virtual production in a course? I'm interested in learning it and start a career around it.
Just contact a studio and go visit. That’s how my videography started back in 2016.
Learning unreal is a great first step.
Probably the first step you could on your own is learning Unreal Engine
What is the minimum pixel density LEDs used in this kind of setups?
Great video as always 💚 please Focus on writing Topics
i want to be a part of the film industry! i’d love working on a set. even if i was just doing mindless physical work not making much i’d still be happy
I think this is the future of filmaking
It'll definitely be a part of it!
Unreal is amazing, and free, which is more amazing, but if you're new to it, just know there is a huge learning curve, so be patient. 😇
Yup, but worth it if you're all in!
@@StudioBinder It absolutely is!
I think the biggest strength of VP is the fix of eye line problem, you're supposed to look at "something" on green screen so.. where is it?
Also I think it's good for a natural low-light scene, since you have limited time to shoot at dawn/dusk or difficult lighting in low light area in real location.
On the one hand, it is amazing what this technology can do.
On the other hand, there is something about a real location with all the imperfections that seems more real and believable.
If they made Lawrence of Arabia with this I don't think the movie would feel the same...
There is a sense in many CGI heavy movies of fakeness. It looks unreal and it can take you out of the experience.
But this saves time and money and yet a true sense of place is lost.
So, do they actually record the led panel or do the then overlay the projected image on top of the led panel?
Yes, they record the actual LED screen. And there is also the option to comp it manually by putting a small patch of green behind the subject. That way you get the wraparound lighting and virtually zero spill.
@@TeroOhranen wow, so are they oled, and then imagine if they are not!!
@@ifell3 Yes, it technically is OLED since all the pixels are small, individual LED lights. The pixels usually also have some diffusion lenses in front of them to disperse the light a bit better and reduce the visiblility of the pixel grid.
Edit: The lenses also are the key to make the individual panels have edge to edge picture so no bezels whatsoever. The panels themselves are usually about 30x30cm / 1x1ft in size.