@@deus1784 No not at all the overall technology is amazing and putting this is strictly false, with a bit of tweaking the system can create sharpened high res image.
@@_vallee_5190 You misinterpreted that as a negative while Deus was in fact trying to use it as a positive, it truly looks like we're looking through a dashcam
Even the "vistas" version looks less realistic. Not 100% sure why and maybe it's just me, but it feels like because it has more color, the aliasing other artifacts art more noticeable and it doesn't look as real as the desaturated dashcam version.
I think the biggest roadblock to good photorealism is that sometimes people don’t realize that reality isn’t always so beautiful or crisp. A 4K texture is just a texture. Depending on distance in reality, colors meld together, and everything isn’t so bright. It’s the imperfections that make something look photoreal, not the lack of
@@jenkathefridge3933 The point the Original Commentator made was that in Life not everything is crisp. Sometimes objects can lack details and such, but if you have 4k Textures the Details often still stay visible even from afar, which doesnt always happen in real Life.
In NVR you can set Less, Default, or More puddles. I think it’s the same with NVE. But all the “RTX Graphics in GTAV” video creators usually use the More Puddles option
@@billyccall5774 photos/videos from dash _cameras_ aren't photo like? Anyway you're missing the point, If there were a different looking image set it were trained on, it'd look just like that set instead. Dash cam footage is largely available and very complete.
The problem is that it doesn't fit GTA 5s location or art style, I could've easily mistaken this for GTA 4, as that game is way more washed out and visually boring like the photorealism captured from Germany.
Which arguably makes it photorealistic, as to get these shots you yourself would be behind the windscreen, probably with a dashcam The funny part is, while driving in a straight line, my mind is totally convinced I'm watching a dashcam, but the second the car turns, the illusion is broken. I love video games :]
They used a model trained via photos taken from a dashcam with a windscreen obscuring it. If they used a different camera and took different reference photos (something that a videogame studio's art department could manage), it would produce results that look like whatever pictures they provided. I think the really interesting part here is that they don't necessarily need to use a "better" camera or "better photos"... An art department could make artistic decisions when producing a reference photo data set; color settings, camera quality, the textures and colors and surface qualities of the objects in photos, etc would influence the end result.
It's very possible to do this in real time. It's just that it's ugly as hell and most companies would rather make pretty visually appealing games than ugly realistic games.
@@phelan8385 You don't need this specific image enhancement model to achieve these results. They had techniques in like 2015 that ran just fine and delivered an insanely realistic experience. As the person you replied to said, it won't happen because people will complain that it looks ugly. Life is ugly 99% of the time.
@@xthinkfast No, it's literally not a mod. You can't install this to your game. Mods are used to modify the game in real time, this doesn't do that. 10 seconds to their page would have told you this, but hey I guess it's easier to be stupid than to be right.
The real hot take is that while it looks more realistic, it also looks uglier. Reality is ugly, I wanna look at the overly saturated base GTA 5 instead. lol
The model is trained on dashcam video frames so it will look like a dashcam video. Could look much better if gopro footages were used which I am sure is not available on this scale.
I would love to see how this program "enhances" the NPC characters walking around in the world. What do their faces look like when looking at it close up after being trained.
There is a person walking right near the end of the video. Can’t really see the face though. I’d imagine the training dataset probably blurs out faces anyway?
This is what ENB/graphic mods creators should be doing instead of oversaturating the colors, overusing ssao and flooding the floor and making it look like a damn mirror, and also try to sell that shit for 10 bucks a month
@@ThirstyEdits maybe screen space reflections (SSR) but not rtx, they just make the game look like shit with all of that water and they don't show anything new
That might be more to do with the lack of actual interactivity in the methodology. Movement might be all it is capable of handling, hitting a sign or deforming a car is probably not possible without serious issues.
Imagine if: - GTA V was made in 2021, raising the graphics standard of the base game - The AI dataset was made with a 4K camera instead of a LQ dashcam - The AI dataset was recorded in Los Angeles instead of Germany, matching GTA V's setting The result would be insane.
Wow. I love the version trained on typical dashcams. I have always said I’d love to play a game that had realistic graphics, not high res, or ray traced etc. But actually realistic graphics, even if it looks low quality like a dash cam. Amazing work
@@howisotamatoneoinuse7964 I think that would be impossible with current hardware, whereas dash cam versions wouldn’t. I think that’s because the dynamic range of human vision is much larger that what a monitor can reproduce - I could be wrong on that. You do make a valuable distinction tho
@@howisotamatoneoinuse7964 If you watch a dashcam, or a phone camera or whatever digital video camera, you don't think it's unrealistic or CG. It doesn't have to be human perception levels of quality to look realistic, it just needs to look like the real world the way we are accustomed to seeing it.
It's one of the reasons why old valve games like half-life 2 could pass for a low quality image if you squint. They're great at making colors look realistic, even if the models and textures were low quality. Rockstar has also been getting better at this lately with RDR2.
This is what treyarch needs to learn about black ops. I see black ops and think everything looks too bright and oversaturated, and that degrades the graphics.
That's very impressive! Just a side note, if the footage was made with a gamepad steering smoothly it would be even better for the showcase, the hard turns makes you remember that it's a game 100% of the time lol. Nevertheless, awesome stuff!
This is why GTA 4 still looks real sometimes despite having lower fidelity graphics, the colours are more true to life. Anyway, I achieved this by just upping the green tint on the TV, and it made GTA 5 look way more lifelike and real. It doesn’t make it go green it just makes the colours look more natural like this video.
Exactly if you go back and even watch the gta 4 trailers the whole color system gave that game such an realistic feeling. I live in Germany and here in winter it very feels „grey“ and in summer „green“ just exactly like in this video. The matrix unreal engine demo felt also so realistic I think because of its „green“ colors
The colors in this video look extremely unnaturally green to me like they added a Matrix color filter on it. There is also too much greenery in general when LA does not have nearly that much vegetation that is so green. IMO although the original looks a lot more true to real life simply because it used LA for reference unlike the AI which only has data from Germany. To me the new images do not look realistic at all.
Go outside during spring or summer. Look at some grass and flowers. You might start to realize that the real world can actually be beautiful, and that “gray and gritty” doesn’t equal “realism”.
@@kalecccxi333 all of you are expertly wrong. The closest source to life like realism is Kodachromes. It has the sun exposure, the dark mix of colors, and the correct saturation unlike modern cameras that lack both frequencies.
I think the problem is with the method itself, maybe it can't handle 1080p+ images yet, or maybe it takes too much processing to do, as the game was running in 20fps.
It's an early tech. I'm sure they will be able to render in 1080 and more in the near future. But to expect something that looks this good to not have limitations is crazy. There are always limits on tech until they are refined. We all just gotta calm down and be patient lol
That's the trick with just about every "photo-realistic" claim. Blurring everything. Your brain fills in the gaps to support the illusion and you can't point at anything in particular that doesn't look realistic because it's all blurry. And if you try to point this out, they have the copout excuse of "Oh, we said PHOTO realistic. As you can see, this is blurry just like a russian dashcam". Like, dude...
My third grade teacher: “quit putting ‘the end’ the end of your paper. It makes you sound dumb” These guys, obviously smarter than my entire hometown combined:
@@StereoTyp0 first how is that grammatically incorrect, just asking out of curiosity, since this is irrelevant to the point being made, because put "the end" is more a choice than anything else.
@@whyitmatters6906 "produces fewer artifacts", would be correct line. "Less" is used not supposed to be used with discrete nouns being counted. For example, if I said, "there were less people at the store", it grammatically implies that I'm referring to some measured amount, such as the mass of the people missing. It basically implies a strange observation such as, "there were 123.4 kgs less people at store". This reads as strange because it divides discrete units such as individual people. Conversely, using "fewer" with mass singular nouns is equally incorrect, e.g. "I used fewer salt to season the soup". Either way, this grammatical rule and the use of "the end" are both examples of a writing style that I would find unacceptable from a professional writer but be less offended to find in a presentation written by a professional engineer. Edit: accidentally a word.
this is where games are going. not just AI behaviour and intelligence to allow them to understand and act based on your natural speech (like the games that the main character plays in the movie 'Her') but also stuff like this that makes the game look damn near real. this might even be a reshade mod in 5-10 yrs..
I'm no engineer but seeing how many processes are necessary in order to achieve the end result I think the computing power of consumer end PCs won't be able to give such an output for a little bit longer. It's doable on really beefy machines, but I doubt it's done in real time otherwise the framerate would be absolutely horrendous to look at for extended periods of time.
@JET0802 I didn't get them either. Los Angeles is sunny and colorful enough to really look like that. But they come um with a German grayish landscape. Wtf??
If they make a simple enough software it can become a Instagram/tiktok trend lmao. Input your images and the engine will render them to look as if you were inside the game.
This would look realistic if our eyes saw the entire world around us with the quality and resolution of a dash cam on a car, because that's the source footage the neural network used as the reference. The real world doesn't look like that at all. So no, this is not "realistic", this is just playing GTA 5 with a dash cam filter or shader on top of everything, replacing the textures and lighting FX. Interesting and promising, anyway.
TH-cam really did you nasty with lossy compression. the images on the site are strikingly photorealistic, to the point that looking back at GTAV you can immediately tell what looks off. That game that used to represent a standard for photoreal graphics in AAA defeated so mercilessly is jaw droppingly awesome. Though one minor complaint I would put forward us the cityscapes color washing out GTA's vibrant LA theme. perhaps some LA _esque_ colorgrading on the training material or your result would give a more appreciable image. Mappilary doesn't suffer from that discoloration but I feel its result isn't as convincing
Well it is a photorealistic enhancement. By re-rendering each frame, it naturally loses some of the vibrant colors that were deliberately decided on when coloring the scenes of the game.
@@cane870 so would you prefer to watch movies without color grading ? plus you've completely missed my point. the discoloration doesn't come from a place of photorealism but from the limitations of dash cam grade footage. I'm saying that fixing it would make it look better, not more photorealistic.
I don't find it that impressive tbh. I think rockstar could make it look like that if they wanted if they tweaked the textures (the most obvious would be to make the road texture have less contrast), car reflections (they could use raytracing nowadays) and tinkered with the color grading. However, GTA was never aiming to be 100% photorealistic. While it's very detailed and quite realistic, it always had an art style. Also, remember it's a 2013 PS3/X360 game. Like, it's good but not THAT groundbreaking. If they used it on GTA3 level graphics and get these results that would be way more impressive. But it doesn't seem to add in much geometric detail apart from the vegetation.
well really it's not defeated, because gta v oem graphics look better, but that was the point the colors are more vibrant, and everything is meant to be ultra realistic when in reality, everything is a bit more depressing. This program did a great job at somehow making things look more like a HD police dash cam than graphics in a video game.
Man they need to run a realistic physics mod because the jerky car physics are just about the only thing that makes it immediately obvious this is a game.
I think games will keep their game in the cartoonish realm so people can't abuse the system. And get a ton media hate on how video games kill people lol. Pretty sure we will be living in a virtual world by 2040 :P.
I remember when Anti-Aliasing options first appeared as 2x, it could cut frame rate by 2. So in theory if we would accept 30 frames per-second again for a while, re-renderering a frame based on AI analysis might not be THAT mad of a technique.
i dont think there will be that much of a difference cause its rendering real time photos not a model so that will help but ofc 8gb of ram wouldnt be enough i guess 12 gb of ram should be good for it tho the game is highly doubted to run no more than 30 fps so yeah thats it if you ask me i guess the minimum requirement would be, 12gb ram GTX 1050ti tho its just an assumption
@@selamentor Yep. Plus while sandbox type game is really heavy on "continuity" comparison, imagine something slower, like adventure horror or even virtual found-footage game experience.
@@CJAM03 as a person thats lived in LA m whole life there is some places that look a bit run down or kinda of ghetto like grove street but with more apartments but it's mostly potholes in the streets and um... well potholes ^-^
I've been thinking about this a lot lately: at this point in technology, I think the least realistic aspect of video game graphics is just the oversaturation and sharpness of everything.
Add to that better physics engines, capacity for higher asset density, and more realistic AI. The physics engines in games still make everything feel too clunky or weightless, most open world games have large maps but are often mostly comprised of shell assets which are static and can't be explored or interacted with, and interactions with most NPCs still remain immersion breaking imo.
It makes it more pleasing to look at. The real world itself is beautiful in its own right but more boring to look at than say an 8k rain enhancer script in gta 5
Yes and no. We already deal with a bunch of people who don't even know how to model anything bespoke, going into archviz because the stock models and rendering engines are cheap and good. The low bar of entry lowers the overall value of the work, as more people flood the market offering their services (though this is visually offset by the fact that stock models and rendering engines are so good now). I observed the same issue in the field of photography - cameras got cheaper, better, smaller + the internet started offering endless tutorials and free stock (unsplash, pexels, etc) = hard to find well-paying work for everyone, because Joe Schmo can show up at the door and do it for next-to-nothing + more and more agents shift to just doing it on their phone. A lot of stuff that used to be photographic jobs - moved to 3D, where it's easier and faster. A lot of 3D also moved overseas, where a guy from India can do 3-5 jobs for the price of 1 in the west. Etc etc etc. Basically what I'm saying is - it's your own demise. Fun at the start, "yay tech!" and all that, but ultimately you'll need to change professions to put bread on the table because at some point this tech will make it impossible to make money anymore. Short-term thinking vs long-term reality.
@@TheUltimateBlooper A low barrier to entry is great. If your work is reliant on there being a higher barrier of entry, then maybe your work is shit in the first place? After all you're basically admitting it's just a synthetic barrier that is helping you. We're going to end up making the art accessible by tons more people with much less work requires, and that's only a good thing.
@@TheUltimateBlooper this is ludicrous logic. By that logic, there should be zero professional photographers. Tutorials and demonstrations mean absolutely nothing if you are incapable of doing it as a client, It's the same reason why TH-cam has videos showing how designers make their products. Sure, someone could go out and buy all the materials and tooling needed and recreate it, but the artisan relies on the fact that people's time is more valuable than simply paying the right person for the job
@@TheUltimateBlooper a bit agree with you. Archviz videos used to be super expensive and now plummeted because Lumion. But, just like another job, we need to step up our efforts harder than ever using these new technology. And don't put all of your eggs in one archviz basket, you can do TH-cam, artistry, or whatever
DISCONTINUATION OF PROJECT: This project will no longer be maintained by Intel. Intel has ceased development and contributions including, but not limited to, maintenance, bug fixes, new releases, or updates, to this project. Intel no longer accepts patches to this project. If you have an ongoing need to use this project, are interested in independently developing it, or would like to maintain patches for the open source software community, please create your own fork of this project.
The competitors aren't trash per se, they're just processing the images. These guys are pulling object data from the game engine to tune the process. I'd imagine a game dev could work an engine like this into their game. Heck, rather than use libraries of dashcam footage, Rockstar could literally pull some 4K or 8K camera footage from Los Angeles themselves. Also, imagine having an on-the-fly FaceApp-style filter applied to the characters to give them real face replacements.
@@GiuseppeGaetanoSabatelli it's awesome technology! As a proof of concept I think it has a heap of potential and I'm keen to see something like this implemented to games via GPU similar to DLSS and ray tracing. don't worry my comment on the competitors was purely satirical. I just think most of these companies need to be able to explain and demonstrate in layman's terms. It just overwhelms and alienates a solid portion of the audience.
@@GiuseppeGaetanoSabatelli Personally, I didn't interpreted the competitors as being "literally" more thrash. This video is simply a demo to support their research publication, and the goal for research publication is to convince that your proposed solution is novel and effectively solve complex and relevant problems compared to other methods that already exists. So of course you will try to demonstrate that you were able to improve from other previous related work. And I think what amused me the most from reading this comment is the fact that there is a dramatic increase in the amount of papers using Deep Learning instead of manually finding better algorithms to solve quite complex problems, and they can be more or less summarised like this: "We chose an architecture like this, found these hyperparams, and now we can basically do this thing 10x times faster and better than the algorithm you guys been working on for the past 5 years" which can be quite baffling. (I am not trying to say this is wrong though, there's a limit in what we can achieve with conventional programming and ML is there of that and it's there to stay) On a side note, I don't think we are nowhere near to be using this type of technology in games. When a paper claims the algorithms work at interactive rates (so not real-time rates), it means maybe 10fps minimum. In the conclusion of their paper, they mention that their system in its unoptimized forms takes half a second for rendering on a RTX 3090 GPU, which could be improved with appropriate use of G-Buffer. I also think most people mistakenly believe that this is some kind of company putting forward a "proof of concept" to be implemented in games. They are not, the three are all research scientists working for different firms (two of them are from Intelligent Systems at Intel)
@@arekkusu0o it looks worse and similar to GTA4, because as they said, they used images from irl germany and they were washed out grey. If they had used images from California, it would be more colorful. And they did show a better colored version at the end of video around 7:00 I think.
Also have to remeber these aren't 4k cameras these are basic dashcams and photos from germany. Strap on 4k cams and go to LA and its a whole different story
Unfortunately it hasn't been updated since the prototype phase and a month ago Intel announced on Github that they are discontinuing the project. Sucks because it's a pretty cool idea. Hopefully they'll start a new project like this and make it commercially viable
Some people are memeing in the comments, but genuinely, my jaw's a bit agape. For most of the footage altered by the software, it genuinely looks like a google street view camera, moving in front of me... although with higher camera quality, and it feels much more realistic to human sight, rather than simply a camera's footage. It's genuinely astounding to me just how amazingly real it looks! I never thought photorealism could look realistic, there'd always be that uncanny valley to it, but... this video changed my mind on that, that's for damn sure.
The game looks like a smoother GTA4. Rockstar could've done this but didnt because its bland. Games have style. Gta5s style is west coast 90s. Supposed to be like a Tupac video. And I wouldnt even say it looks realistic. Real life is alot more colorful than this especially in the US, especially in a city like LA. Looks like a dashcam from 2003. It's somewhat impressive sure but then again rockstar could do this if they wanted
@@jaystuder4458 Rockstar right now could make a GTA 6 that looks similar, but in 2013 they could not come close to this. Not to mention this tech does not actually render any 3d graphics, it just uses AI the generate the frames. Completely different.
@@JonDoe-uq1mk people made mods that looked almost this good when the game first came out rockstar is a billion dollar company with millions of workers and they could definitely do this they chose not to because it just doesnt look appealing
I wonder if the results would be more accurate if you used images of Los Angeles in the dataset, to more closely match the setting of GTAV? This is fascinating stuff.
Can confirm the lighting is a bit more white/yellow, not green, here. We tend to not have a lot of overcast days, most of the time the skies are clear, and we're right off the ocean, too. It's not a huge deal but while neither quite match the true lighting in LA, GTAs is a bit closer while the mod's realism is a lot better.
I suspect that the dataset German city streets is 720p at most (they said "automotive quality", which is a nice way of saying not very high quality at all). For higher resolutions, you would need higher res reference data.
@@VincentNacon I highly doubt the enhancement is running on the same machine. It's also likely not running in what gamers would consider real-time. "Interactive frame rates" is a nice way of saying "far less than 30fps", just like "automotive grade quality" means low-res.
That's the reason why i always thought why GTA 4 seemed more realistic to me than GTA 5 in terms of graphics and the driving physics. the cars driving camera wasn't in the center of the car it was more to the left. and the colors of the city when everyone thought its dark because the game had a darker story and thats how niko was viewing liberty city. it turned out because of how GTA 4 was the first HD GTA game and not like the old 3D GTA games before, it would make sense if they actually tried to make it looks closer to real life back then.
i find it hilarious that the photoreaism thing makes it look more like gta 4. ive been saying it since gta 4 came out, that game just had such a realistic vibe to it. it was on another level.
It was embedded in the physics engine as well. Drive a car into a wall and GTA4 and then do it in 5. The contrast is stark. GTAV with GTA4 physics wouldve been the shit but people whined about it being too realistic
@@isaacsrandomvideos667 like u said, EXACTLY!! gta 4 has extraordinary graphics, its just the resolution that was aged. the graphics themselves and even more so the colours, were just special. that world felt real when i first played it. i was in absolute awe!!
Effectively yeah. It's a weird concept to prove you're human by teaching the robot what humans see. But automatic cars would be quite difficult to implement without it knowing that the leaf that crossed it's sensor is not something worthy of an aggressive lane change to avoid an accident.
No I guess cause when you choose the wrong images then you are not allowed to proceed,that means the AI already has the info of what the correct images are.
I always thought smoother, less detailed roads were way more realistic. It just makes everything feel way bigger, and it's not like you can actually see every little rock on the road when you're sitting in a car.
@@Sponge_Bob_Square_Pants You don't really see the details while standing still though either. At least not nearly as much as the original textures show.
Well from what o know Los Angeles roads are way more "detailed" with potholes and cracks than Los Santos (The network was trained on german roads) And like real driving you don’t look at the texture of the road too close Colors and reflections are the important aspect here for realism
Did you notice the jerky controller input? Why didn't they use a wheel, or stiffer thumb, or mouse, or pong paddle? They ruined the real side for me, like the driver had a wasp in the cab!
It's very straight-forward stuff. They tell computer "try creating random filters until it turns pic 1 into pic 2" and eventually it works. That's all neural nets are, essentially trial and error.
@@themodfather9382 lol its because they use so many big words and abbreviations. at some points I just found myself dozing off and hearing TV static 😂😂
It astonished me that the bleak, grayish camera filter makes GTA 5 looks grounded with reality just like the _COPS_ TV show than the typical blockbuster Hollywood movie.
The color tint is due to them using a dataset made in Germany, with different sun strengths. Imagine this tech, but with Rockstar actually driving through LA with high-end camera's.
I'm sorry but this is complete horse shit. Sunny days look the exact same as in the US, apart from solar angle. It's like how Mexico is always portrayed as red in movies but there is no difference. Same as Germany, there's no difference
Something people dont realize about photoreal images is that reality is often far less exciting to look at than fiction. Colors are washed out, textures dont pop as much. Photoreal games aren't a good idea save for a couple use cases like simulators. Games are meant to tell a story and visual interest is necessary for that. Making a game like GTA or Cyberpunk look real subtracts from the overall experience. Its a facsimile thus it shouldn't be real. Nonetheless, this is incredible work and its amazing to see. I'd love to see technology like this put to use in something like MSFS or Assetto Corsa.
Finally someone reasonable. So many people circlejerking about realism in the comments yet they don't realize that games looking like this have been possible for a long time, just most people actually wouldn't play a game this ugly.
No offence but your comment tells me you need to get out more. So many people these days, especially gamers live their lives vicariously through television, computer screens and dont realize the real world is actually much more colorful and sharper than anything we can experience through a screen. As for games, we still got a fair way to go before it can come close to replicating reality.
It's so realistic, it fixes broken American roads with efficient, clean and well maintained German roads. Edit - For complete morons out there who need to psychoanalyse this post. It is a jab at German efficiency and the generalisation thereof from the early 1900s. For those of you too dense to understand, Clearly not every US road is bad and not every German road is good. If you watched the video you will get that the roads were smoothed out by the German town footage and the streets in the game GTA 5 were shoddy. Hence the joke that German efficiency fixed the roads. Nothing more, nothing less. 800 people understood the joke, but you had to go and be special didn't you?
FINALLY, Someone who understands that realism isn't all about hyperdetailed textures and intense lighting. The crazy overdone rendering is what makes very high quality games just not look real. When you want to set a mood or tone then realism isn't needed, but if you specify that you want realism then you must cut back on the texturing and details and lighting. Edit: People in the replies keep saying that, "no, the other looks better" you are fools. Not because your opinion is wrong, but because of your reasoning. The new one shown is completely realistic visually besides the dreariness of all of the visuals and even that is debatable because real life often does look like that with overcast and cloudy/slightly foggy days. All of the graphical changes in the new version looks like something you could see in real life 1:1 while the original is clearly a game. It's not about what looks better or which one you prefer, it's about making photorealism look as close to real life as possible, and the new version definitely accomplishes that.
Actually textures are what give that photorealistic look, details are very important too, to make the world feel alive. On the other hand, over-the-top lighting and absolutely exaggerated post processing makes everything look awful and fake Also motion doesn't get enough love :( (animations and physics)
if you want to know more of this kind i recommend the channel ''two minute papers'' they explain their works on machine learning just like this. Maybe gives better idea :)
"We pass the G-Buffers to multiple convolutional network streams and fuse the streams again. The resulting feature tensors are further processed by residual blocks, which output tensors at multiple scales."
@@MatthiasPitscher Apply the tantulus generator with static polarity to the paraphoretic bipolarized grid, then reionize the isolinear tactical chips to get the stational compensators aligned with the multisynaptic structures.
@@skatman3278 It think it looks that way because the image they used had that green/blue tint. I bet that if they used a more vivid and colourful image, the end result would be much more vibrant.
@@roguescorner9042 agreed, the photo set clearly makes a difference as at the end you see a much more vibrant version of it made using a variety of city images rather than the mostly German cityscape set
That's pretty awesome! Now all you need to do is get a better camera, mount it outside the car (not through the glass window since it gives that color tint look) and record the real L.A. place in HD or 4K.
they have to do this trained on realistic dashcams (or just cameras in genera). But it CAN'T be phone cameras, it has to be cameras that capture color and light correct.
Having this with a VR headset and hand controls would be like a dream. The images are clear enough to feel real but are slightly off to feel like a dream.
![SAFEPLANET - ดาวเคราะห์ [ THE PLANET ]](http://i.ytimg.com/vi/4X1XL3I_k3c/mqdefault.jpg)
How is it photoreal if there isn’t 600 gallons of water on the ground
Underrated comment.
Lmfao
Thank you for this
For real all them mfs used was water
I remember seeing a mod showcase where the sun was as close as the moon.
It's crazy how the photo-realistic version actually has *less* details, but looks more real.
Its like it was recorded with a shitty camera lol
@@deus1784 No not at all the overall technology is amazing and putting this is strictly false, with a bit of tweaking the system can create sharpened high res image.
@@_vallee_5190 yeah but it still looks like it was recorded with a shitty camera
@@_vallee_5190 You misinterpreted that as a negative while Deus was in fact trying to use it as a positive, it truly looks like we're looking through a dashcam
Even the "vistas" version looks less realistic. Not 100% sure why and maybe it's just me, but it feels like because it has more color, the aliasing other artifacts art more noticeable and it doesn't look as real as the desaturated dashcam version.
I absolutely understood nothing, but it looks great
Lmfao 🤣
Same
Lol
Same
It actually looks much worse, but also more realistic. I never noticed how ugly real life was before.
I think the biggest roadblock to good photorealism is that sometimes people don’t realize that reality isn’t always so beautiful or crisp. A 4K texture is just a texture. Depending on distance in reality, colors meld together, and everything isn’t so bright. It’s the imperfections that make something look photoreal, not the lack of
If you put 4k texture on everything the game wouldn't be able to run at a high fps
@@jenkathefridge3933thats not the point.
@@TheBlueNeutron Then whats the point?
@@jenkathefridge3933 The point the Original Commentator made was that in Life not everything is crisp. Sometimes objects can lack details and such, but if you have 4k Textures the Details often still stay visible even from afar, which doesnt always happen in real Life.
@@anti1917 That is true
For once a realism mod that doesn’t just add million puddles and reflections
and oversaturated bikini girls for clickbait
too bad they didn't use realism examples of hoes
In NVR you can set Less, Default, or More puddles. I think it’s the same with NVE. But all the “RTX Graphics in GTAV” video creators usually use the More Puddles option
Fr
its not really a realism mod, cause they just really remastered the rendering engine to look like Germany instead of crazy vibrant colors.
"It looks dull and like a dashcam"
Yeah no shit that's what it was trained on
Wonder how many comments saying that line i can find here. Probably a lot, but anyways, tbh this video was pretty darn cool, dashcam or not
So it's not "photorealism" is it is "dashcam realism"
@@billyccall5774 photos/videos from dash _cameras_ aren't photo like? Anyway you're missing the point, If there were a different looking image set it were trained on, it'd look just like that set instead. Dash cam footage is largely available and very complete.
nice pfp
The problem is that it doesn't fit GTA 5s location or art style, I could've easily mistaken this for GTA 4, as that game is way more washed out and visually boring like the photorealism captured from Germany.
If you show this and tell me it is a dash cam footage, I wouldn't even recognize
@@row8261 that one guy who never gets the joke
@@quartermaster2809 and the one guy who deletes their comment after they realise they were wrong lol
@@rayanrashid7413 lmao
that one guy who can't relate to what these people are saying because context was removed
@@astral6749 haha
3 years later, ai reimagined gameplay footage became a thing
it looks like a dashcam that has a windscreen obscuring it
that is exactly how it was made if i understand correctly. All of the reference shots were taken from a dashcam in that mercedes they show.
@@user-fc5ou7pn2k well more of a camera than a dash cam but yeah basically
Bruh look at 7:40
Which arguably makes it photorealistic, as to get these shots you yourself would be behind the windscreen, probably with a dashcam
The funny part is, while driving in a straight line, my mind is totally convinced I'm watching a dashcam, but the second the car turns, the illusion is broken. I love video games :]
They used a model trained via photos taken from a dashcam with a windscreen obscuring it. If they used a different camera and took different reference photos (something that a videogame studio's art department could manage), it would produce results that look like whatever pictures they provided.
I think the really interesting part here is that they don't necessarily need to use a "better" camera or "better photos"... An art department could make artistic decisions when producing a reference photo data set; color settings, camera quality, the textures and colors and surface qualities of the objects in photos, etc would influence the end result.
So this is what GTA IV's color grading was trying to achieve..
pretty much lol
I like how the quality loss helps to achieve the effect this is not GTA V but a car's camera
deus ex also tried similar approach iirc
hahah
lol
The most impressive part about this is that they're playing GTA V while actually respecting traffic laws
this lol, was expecting him to hit a pedestrian in the end there
maybe scenes violating traffic laws are not in their dataset so may create artifacts?
Yea by driving between cars and driving on the wrong side when he was behind that bus lmao
😂
Now that's RP *GOATED*
This is the most realistic gameplay we'll ever see. Imagine future engines doing this in real time.
@Cristiano dos Santos Gomes That's because it's probably ✨gReEn✨
Check out "Unrecord"
It's very possible to do this in real time. It's just that it's ugly as hell and most companies would rather make pretty visually appealing games than ugly realistic games.
@@harrasikaCan't run on consoles yet so it ain't happening.
@@phelan8385 You don't need this specific image enhancement model to achieve these results. They had techniques in like 2015 that ran just fine and delivered an insanely realistic experience. As the person you replied to said, it won't happen because people will complain that it looks ugly. Life is ugly 99% of the time.
finally a realistic graphics mod without making the floor wet
this isn't a mod
@@bloomingteratoma Its a mod its called ai training
@@xthinkfast No, it's literally not a mod. You can't install this to your game. Mods are used to modify the game in real time, this doesn't do that. 10 seconds to their page would have told you this, but hey I guess it's easier to be stupid than to be right.
@@bloomingteratoma Hey look, I managed to find 1 guy with a brain in the comments. You are correct, this is not a mod.
@@godthegod4491 bro go outside why you care so much ??
So this is why the matrix had a green tint
good point
Because it was filmed with a cheap dash cam?
watch until the end
@@lddroRre I feel you
The only thing holding this back is that you feel slightly more guilty when you kill a random pedestrian
Nah m8, crowbar fps go brrr
Yep. that's what i'm talking about 😂😂
Lets get ptsd
I don't feel guilty.
Wdym with "slightly *more* ", do you feel guilty for killing a npc or what? XD
Hot take : adding more lights, colors, and reflection doesn't always make the game realistic
and everything being permanently wet.
That is not a hot take that is a fact.
The real hot take is that while it looks more realistic, it also looks uglier. Reality is ugly, I wanna look at the overly saturated base GTA 5 instead. lol
@@DemoniteBL Then your brain my friend is melted to the core of over saturation
Hot take: graphics don't matter one single bit IF the game isn't fun to begin with, no matter how good they are.
Game developers: "let's make this game look detailed and colorful to be realistic"
Some German Guy: "realism is Russian dashcam video"
The model is trained on dashcam video frames so it will look like a dashcam video. Could look much better if gopro footages were used which I am sure is not available on this scale.
But its german dashcam video
thats the actual definition of realism, whereas other variations of realism is actually just 4k
It does look photo real tho
I see you didn't actually watch the video.
I was expecting a bad mod showcase but I'm actually impressed by this.
REALISTIC GTA V **NOT CLICKBAIT**
Maybe its because its made by intel...
@@strongstonks7699 This is the most impressive thing they’ve released in a while then!
Maybe bcs the amount of work under this is probably a thousand times greater than of any game mod ever developed lol
How to download?
Wow, that looks legitimately real. Like it was filmed in the 2010s.
In few papers down the line, results will be more amazing.
7:47 bumps things up a notch
@@luckys541 wink wonk
@Slam Nuts On Table Ok nut slammer 😈
GAY RIGHTS 🏳️🌈
The comparation with the Los Angeles dataset really puts in perspective of how well Rockstar captured the Los Angeles atmosphere in GTA V
Him: Perceptual Discriminator, G-Buffer Encoder, ReLU
Me: *eats Dorito* Yes, yes of course...
"i like your words magic man"
Write that down, write that down...! It's all coming together now!
@@Mystixor Literally comics that make fun of daily life and somehow make it into something that's actually funny 😂😂😂
Swag jesus The Bromans are planning to capture you please hide
I understood that reference.
I would love to see how this program "enhances" the NPC characters walking around in the world.
What do their faces look like when looking at it close up after being trained.
I was thinking the same thing
There face wont change much it would look like u have just applied some filter.
There is a person walking right near the end of the video. Can’t really see the face though. I’d imagine the training dataset probably blurs out faces anyway?
@@mbcchoudhari885 I mean it's more than just a filter so if its taught well it could prob do it
@@blzrL hmn yeah maybe
This is what ENB/graphic mods creators should be doing instead of oversaturating the colors, overusing ssao and flooding the floor and making it look like a damn mirror, and also try to sell that shit for 10 bucks a month
bruh they do that to show the RTX effects bruh use some brain baka
@@ThirstyEdits there's no rtx in GTA v because the game cannot handle rtx bruh use some brain baka
@@ThirstyEdits maybe screen space reflections (SSR) but not rtx, they just make the game look like shit with all of that water and they don't show anything new
Some of them don't overdo it: th-cam.com/video/-S24gQntcWg/w-d-xo.html
@@lalala-t6d Yes I know, but a lot of them just make the road look like a mirror and that's annoying
If a AAA studio released a game with your realism filter, game streamers would call it dull.
I want a one hour drive through the whole map with this realistic POV only.
but with better fps
@@Kayshots and played with a controller at least
@@SerpentSeven777 my thoughts exactly lmao
its better and cheaper to go to LA and drive around in a rented mercedes benz, than buying a PC than can run this photo tingamagic
@@tpenoel88 what if i want los santos?
This is actually photorealistic, unlike every other graphical enhancement mod for GTA that just increases reflection and make every road wet
Finally someone who gets it
Wet is best 💦👍
and also makes everything colorful like a cartoon show.
@@ogblue8159 What, your world doesn't look like a constant LSD trip?
@richardhalo yea thats not real but look at the trees its just like real life ,
Impressive..It's so realistic, it makes you obey traffic laws.
Lol
That might be more to do with the lack of actual interactivity in the methodology. Movement might be all it is capable of handling, hitting a sign or deforming a car is probably not possible without serious issues.
Yo lo hacía en gta vice city
Not if you're under 18 and don't drive!
@@josex6159 ?
All y’all saying the original looks more realistic actually needa go outside 😭
This is the reason why Gta IV felt more realistic than gta V.
Fr
.
100% agree
Also GTA V's vivid color pallette was likely an artistic choice in sense that Los Santos is supposed to be a kind of bling bling uplifted lifestyle
Came here to say this
This looks better than their “enhanced and expanded” version
where can i download this mod ?
Everything looks better than E&E
@@albinjt its not a mod
Shame to rockstar
any gta 5 gameplay is better then e&e ver
Imagine if:
- GTA V was made in 2021, raising the graphics standard of the base game
- The AI dataset was made with a 4K camera instead of a LQ dashcam
- The AI dataset was recorded in Los Angeles instead of Germany, matching GTA V's setting
The result would be insane.
Imagine they travel in time toward future to film 8K dataset and they use it on Cyberpunk ahah
One can dream... Maybe in a decade who knows, but games are getting more and more ""ultrarealistic"" or cartoonish
Just wait for a ten years. We will see them all.
so basically gta v if rockstar wasn't lazy
Imagine if a video dedicated to showing graphics off wasn't uploaded at 720p in 2021. FFS ppl
Wow. I love the version trained on typical dashcams. I have always said I’d love to play a game that had realistic graphics, not high res, or ray traced etc. But actually realistic graphics, even if it looks low quality like a dash cam. Amazing work
Realism at it's core wouldn't be mimicking a dashcam view, but the eyes. But this new uprising of dashcam enhancements is promising.
@@howisotamatoneoinuse7964 I think that would be impossible with current hardware, whereas dash cam versions wouldn’t. I think that’s because the dynamic range of human vision is much larger that what a monitor can reproduce - I could be wrong on that. You do make a valuable distinction tho
Bet you were on your toes when the unrecord trailer dropped
also stopped by to mention the game "Unrecord", sounds right up your alley
@@howisotamatoneoinuse7964 If you watch a dashcam, or a phone camera or whatever digital video camera, you don't think it's unrealistic or CG. It doesn't have to be human perception levels of quality to look realistic, it just needs to look like the real world the way we are accustomed to seeing it.
Its like an old recording from the 90s or early 2000s. Very impressive.
like in those earlt 90s rap music videos.
shhh, they've only just discovered sub HD
The filter is not bad but imagine playing GTA5 like this
“Just adding more lighting doesn’t give it better graphics” is what this video screams to me
It's one of the reasons why old valve games like half-life 2 could pass for a low quality image if you squint. They're great at making colors look realistic, even if the models and textures were low quality. Rockstar has also been getting better at this lately with RDR2.
This is what treyarch needs to learn about black ops. I see black ops and think everything looks too bright and oversaturated, and that degrades the graphics.
Ya, just because your game looks PRETTY doesn’t mean it looks REAL
@@theioncow18 just play cod4
or water
I was hoping they'd show us a car crashing into a building at 60 mph.
i think we need to crash a bunch of cars into buildings to train the system :D
"oops that was a real video"
I wanna see a group of people get their shit rocked by a m134
search Beam NG Drive for realistic damage simulation
@@AnthonyVD1310 unrealistic graphics tho
That's very impressive! Just a side note, if the footage was made with a gamepad steering smoothly it would be even better for the showcase, the hard turns makes you remember that it's a game 100% of the time lol. Nevertheless, awesome stuff!
This is why GTA 4 still looks real sometimes despite having lower fidelity graphics, the colours are more true to life. Anyway, I achieved this by just upping the green tint on the TV, and it made GTA 5 look way more lifelike and real. It doesn’t make it go green it just makes the colours look more natural like this video.
Exactly if you go back and even watch the gta 4 trailers the whole color system gave that game such an realistic feeling. I live in Germany and here in winter it very feels „grey“ and in summer „green“ just exactly like in this video. The matrix unreal engine demo felt also so realistic I think because of its „green“ colors
The colors in this video look extremely unnaturally green to me like they added a Matrix color filter on it. There is also too much greenery in general when LA does not have nearly that much vegetation that is so green. IMO although the original looks a lot more true to real life simply because it used LA for reference unlike the AI which only has data from Germany. To me the new images do not look realistic at all.
Go outside during spring or summer. Look at some grass and flowers. You might start to realize that the real world can actually be beautiful, and that “gray and gritty” doesn’t equal “realism”.
@@kalecccxi333 And that the place where GTA IV is set isn't colorful and pretty at all. You buffoon.
@@kalecccxi333 all of you are expertly wrong. The closest source to life like realism is Kodachromes. It has the sun exposure, the dark mix of colors, and the correct saturation unlike modern cameras that lack both frequencies.
This video being 720p takes away from the illusion
I think the problem is with the method itself, maybe it can't handle 1080p+ images yet, or maybe it takes too much processing to do, as the game was running in 20fps.
I heard 4K is only just a trip outside away
Your rather look at sub 720P videos at a 1080P? ITll still look like shit
It's an early tech. I'm sure they will be able to render in 1080 and more in the near future. But to expect something that looks this good to not have limitations is crazy. There are always limits on tech until they are refined. We all just gotta calm down and be patient lol
That's the trick with just about every "photo-realistic" claim. Blurring everything. Your brain fills in the gaps to support the illusion and you can't point at anything in particular that doesn't look realistic because it's all blurry.
And if you try to point this out, they have the copout excuse of "Oh, we said PHOTO realistic. As you can see, this is blurry just like a russian dashcam". Like, dude...
My third grade teacher: “quit putting ‘the end’ the end of your paper. It makes you sound dumb”
These guys, obviously smarter than my entire hometown combined:
Exactly my thought 😂😂
"Produces less artifacts" is grammatically incorrect. Just because you are a ML researcher does not mean you know how to "write good".
French filmmakers have entered the chat
@@StereoTyp0 first how is that grammatically incorrect, just asking out of curiosity, since this is irrelevant to the point being made, because put "the end" is more a choice than anything else.
@@whyitmatters6906 "produces fewer artifacts", would be correct line.
"Less" is used not supposed to be used with discrete nouns being counted. For example, if I said, "there were less people at the store", it grammatically implies that I'm referring to some measured amount, such as the mass of the people missing. It basically implies a strange observation such as, "there were 123.4 kgs less people at store". This reads as strange because it divides discrete units such as individual people. Conversely, using "fewer" with mass singular nouns is equally incorrect, e.g. "I used fewer salt to season the soup".
Either way, this grammatical rule and the use of "the end" are both examples of a writing style that I would find unacceptable from a professional writer but be less offended to find in a presentation written by a professional engineer.
Edit: accidentally a word.
this looks eerily realistic, it just looks like dashcam footage at this point
Perhaps because it's supposed to look like dashcam footage
this is where games are going. not just AI behaviour and intelligence to allow them to understand and act based on your natural speech (like the games that the main character plays in the movie 'Her') but also stuff like this that makes the game look damn near real. this might even be a reshade mod in 5-10 yrs..
who are you
I'm no engineer but seeing how many processes are necessary in order to achieve the end result I think the computing power of consumer end PCs won't be able to give such an output for a little bit longer. It's doable on really beefy machines, but I doubt it's done in real time otherwise the framerate would be absolutely horrendous to look at for extended periods of time.
Whatsup asmongold
what is this "AI behaviour and intelligence" you speak of? games are as stupid as they were 20 years ago
Half Life bhopping in real life incoming!
The real world looks more gray and has less sunshine, got it.
And the moon isn’t right behind the clouds.
7:47
Not at All. There is SunShine All over the World. But Most American Cities it Always looked Gray for some Reason in Real.
As stated in the video, the first set was intended to imitate dashcams, washed-out colors included.
@@SamRichardson1990 weird because LA is very bright and sunny.
So, you've basically made GTA V look like GTA IV?
Take ALL my money.
Literally when I saw it I thought “Looks like GTA IV with better graphics”
It’s because GTA IV was basically perfect
@@OFFtheCHIZANE Only the actual main game tho. Ballad of gay tony and los mc sucked
@@swen6390 stfu theyre GREAT
@@swen6390 those where the best of dlcs for rockstar wtf is wrong with you
yo where are you guys now ??
Rockstar: GTA V
Intel: GTA IV
what are you trying to tell? that Intel's is worse? because IV is 4, VI is 6
Intel knows nothing about graphics 😂
@JET0802 yeah is there no data set for fuckin LA? you'd think that'd be one of the first places that'd have that type of thing lmao
@@netio112 im just asking because people sometimes mix IV and VI
@JET0802 I didn't get them either. Los Angeles is sunny and colorful enough to really look like that. But they come um with a German grayish landscape. Wtf??
Just think about it. THREE People did this. You should show this Rockstar Games
new gta 6 be like
@@furkanyldz8460 nah but the ps5 gta might
Moin Deniz 😂
Rockstar wouldn't implement this. Why? Because it would cost money to implement, and won't earn them any in return
nintendo hire this man!!!#!2!2!2!3?_?'
Ok, but imagine training this AI on a dataset of GTA V screenshots and applying it to real life footage...
WOAH
I like how you think
If they make a simple enough software it can become a Instagram/tiktok trend lmao. Input your images and the engine will render them to look as if you were inside the game.
Or we could go outside and eat an apple
@@shem269 ehhh, kinda boring.
This would look realistic if our eyes saw the entire world around us with the quality and resolution of a dash cam on a car, because that's the source footage the neural network used as the reference. The real world doesn't look like that at all. So no, this is not "realistic", this is just playing GTA 5 with a dash cam filter or shader on top of everything, replacing the textures and lighting FX. Interesting and promising, anyway.
Dang
true
TH-cam really did you nasty with lossy compression. the images on the site are strikingly photorealistic, to the point that looking back at GTAV you can immediately tell what looks off. That game that used to represent a standard for photoreal graphics in AAA defeated so mercilessly is jaw droppingly awesome.
Though one minor complaint I would put forward us the cityscapes color washing out GTA's vibrant LA theme. perhaps some LA _esque_ colorgrading on the training material or your result would give a more appreciable image.
Mappilary doesn't suffer from that discoloration but I feel its result isn't as convincing
Well it is a photorealistic enhancement. By re-rendering each frame, it naturally loses some of the vibrant colors that were deliberately decided on when coloring the scenes of the game.
@@cane870 so would you prefer to watch movies without color grading ? plus you've completely missed my point. the discoloration doesn't come from a place of photorealism but from the limitations of dash cam grade footage. I'm saying that fixing it would make it look better, not more photorealistic.
I don't find it that impressive tbh. I think rockstar could make it look like that if they wanted if they tweaked the textures (the most obvious would be to make the road texture have less contrast), car reflections (they could use raytracing nowadays) and tinkered with the color grading. However, GTA was never aiming to be 100% photorealistic. While it's very detailed and quite realistic, it always had an art style. Also, remember it's a 2013 PS3/X360 game. Like, it's good but not THAT groundbreaking. If they used it on GTA3 level graphics and get these results that would be way more impressive. But it doesn't seem to add in much geometric detail apart from the vegetation.
+
well really it's not defeated, because gta v oem graphics look better, but that was the point the colors are more vibrant, and everything is meant to be ultra realistic when in reality, everything is a bit more depressing. This program did a great job at somehow making things look more like a HD police dash cam than graphics in a video game.
Man they need to run a realistic physics mod because the jerky car physics are just about the only thing that makes it immediately obvious this is a game.
i think things would go a step further if the driver was using a controller, allowing for finer control of acceleration and turning
@@joshua7563 yeah but the problem with that is you can't do much else with a steering wheel once you hop out of the car
@@slin0053 Could have steering wheel and mouse/keyboard or controller both ready to go right next to it
@@Darkhunter218 how many people do you know have the inclination or space to set up a a steering wheel with/beside their mouse and keyboard though
@@slin0053 people who have a steering wheel
The sickest thing about this is, that in 10 years we will look back and think "lol, the graphic wasnt that good actually"
@@lucasfoster8900 how? It looks so realistic.
Its not that good now.
Well this method is not even used by a game yet , it will take more like 20 years for this to be viable assuming computers will keep getting better.
I think games will keep their game in the cartoonish realm so people can't abuse the system. And get a ton media hate on how video games kill people lol.
Pretty sure we will be living in a virtual world by 2040 :P.
@@joeroganpodfantasy42 definitely not 20 years lmao , technology grows exponentially not linearly
“So how much ram do you need to run this?”
“Yeah”
2 fps.
I remember when Anti-Aliasing options first appeared as 2x, it could cut frame rate by 2. So in theory if we would accept 30 frames per-second again for a while, re-renderering a frame based on AI analysis might not be THAT mad of a technique.
i dont think there will be that much of a difference cause its rendering real time photos not a model so that will help but ofc 8gb of ram wouldnt be enough i guess 12 gb of ram should be good for it tho the game is highly doubted to run no more than 30 fps so yeah thats it if you ask me i guess the minimum requirement would be, 12gb ram GTX 1050ti tho its just an assumption
@@selamentor Yep. Plus while sandbox type game is really heavy on "continuity" comparison, imagine something slower, like adventure horror or even virtual found-footage game experience.
@@magnuskallas resident evil 8 has potential tho the orignal graphics are pretty much amazing but a photos realism will change everything
Getting serious "Rockwell Retro Encabulator" vibes from this explainer video...
Was just going to post the Turbo Encabulator lol!!!!
Is this... the panametric fam ?
Bro, I just said the same thing in my head. lol
Rockstar Retro Encabulator
They forgot to mention the non-reciprocating dingle-arm
Amazing stuff, you could further improve this with actual LA footage and more relevant cars....
Oh you don’t want footage of LA... unless it’s from the air and at night or directly looking at the ocean.
@@CJAM03 Stfu… please just stfu
@@CJAM03 as a person thats lived in LA m whole life there is some places that look a bit run down or kinda of ghetto like grove street but with more apartments but it's mostly potholes in the streets and um... well potholes ^-^
@jpeg fern cool bro
@@JovanLemon almost as cool as you liking your own comment 😎
I actually thought the other half of the thumbnail was real life lol, great work guys
I've been thinking about this a lot lately: at this point in technology, I think the least realistic aspect of video game graphics is just the oversaturation and sharpness of everything.
Add to that better physics engines, capacity for higher asset density, and more realistic AI. The physics engines in games still make everything feel too clunky or weightless, most open world games have large maps but are often mostly comprised of shell assets which are static and can't be explored or interacted with, and interactions with most NPCs still remain immersion breaking imo.
@@sword_of_damocle5 i believe that's what cyberpunk was aiming for just missed entirely
I mean speak for yourself. In my experience, the real world is FILLED with color
It makes it more pleasing to look at. The real world itself is beautiful in its own right but more boring to look at than say an 8k rain enhancer script in gta 5
@@litmus7325 Yeah. They're basing their enhancement algorithm off of dashcam footage, which explains the washed out colors.
"Sometimes reality is often disapointing"
-thanos
👏👏👏👏
Sometimes. Often. Pick one.
The joke
@@osakanone
This is a huge shortcut to getting realism with CGI, those of us who work at archviz will be very grateful when it becomes available ...
Yes and no. We already deal with a bunch of people who don't even know how to model anything bespoke, going into archviz because the stock models and rendering engines are cheap and good. The low bar of entry lowers the overall value of the work, as more people flood the market offering their services (though this is visually offset by the fact that stock models and rendering engines are so good now). I observed the same issue in the field of photography - cameras got cheaper, better, smaller + the internet started offering endless tutorials and free stock (unsplash, pexels, etc) = hard to find well-paying work for everyone, because Joe Schmo can show up at the door and do it for next-to-nothing + more and more agents shift to just doing it on their phone. A lot of stuff that used to be photographic jobs - moved to 3D, where it's easier and faster. A lot of 3D also moved overseas, where a guy from India can do 3-5 jobs for the price of 1 in the west. Etc etc etc.
Basically what I'm saying is - it's your own demise. Fun at the start, "yay tech!" and all that, but ultimately you'll need to change professions to put bread on the table because at some point this tech will make it impossible to make money anymore. Short-term thinking vs long-term reality.
@@TheUltimateBlooper A low barrier to entry is great. If your work is reliant on there being a higher barrier of entry, then maybe your work is shit in the first place? After all you're basically admitting it's just a synthetic barrier that is helping you. We're going to end up making the art accessible by tons more people with much less work requires, and that's only a good thing.
@@TheUltimateBlooper this is ludicrous logic. By that logic, there should be zero professional photographers. Tutorials and demonstrations mean absolutely nothing if you are incapable of doing it as a client, It's the same reason why TH-cam has videos showing how designers make their products. Sure, someone could go out and buy all the materials and tooling needed and recreate it, but the artisan relies on the fact that people's time is more valuable than simply paying the right person for the job
@@TheUltimateBlooper a bit agree with you. Archviz videos used to be super expensive and now plummeted because Lumion. But, just like another job, we need to step up our efforts harder than ever using these new technology. And don't put all of your eggs in one archviz basket, you can do TH-cam, artistry, or whatever
I want to know how ps5 version will look
DISCONTINUATION OF PROJECT: This project will no longer be maintained by Intel.
Intel has ceased development and contributions including, but not limited to, maintenance, bug fixes, new releases, or updates, to this project.
Intel no longer accepts patches to this project.
If you have an ongoing need to use this project, are interested in independently developing it, or would like to maintain patches for the open source software community, please create your own fork of this project.
Legitimately thought that y’all switched to real life footage for a second
To summarise what they were saying. "We trained and AI to enhance the game based off a set of images from IRL. Also our competitors are trash."
this summarise pretty much 70% of computer graphics papers these days lmao
The competitors aren't trash per se, they're just processing the images.
These guys are pulling object data from the game engine to tune the process.
I'd imagine a game dev could work an engine like this into their game. Heck, rather than use libraries of dashcam footage, Rockstar could literally pull some 4K or 8K camera footage from Los Angeles themselves. Also, imagine having an on-the-fly FaceApp-style filter applied to the characters to give them real face replacements.
@@GiuseppeGaetanoSabatelli it's awesome technology! As a proof of concept I think it has a heap of potential and I'm keen to see something like this implemented to games via GPU similar to DLSS and ray tracing.
don't worry my comment on the competitors was purely satirical. I just think most of these companies need to be able to explain and demonstrate in layman's terms. It just overwhelms and alienates a solid portion of the audience.
@@GiuseppeGaetanoSabatelli Personally, I didn't interpreted the competitors as being "literally" more thrash. This video is simply a demo to support their research publication, and the goal for research publication is to convince that your proposed solution is novel and effectively solve complex and relevant problems compared to other methods that already exists. So of course you will try to demonstrate that you were able to improve from other previous related work. And I think what amused me the most from reading this comment is the fact that there is a dramatic increase in the amount of papers using Deep Learning instead of manually finding better algorithms to solve quite complex problems, and they can be more or less summarised like this: "We chose an architecture like this, found these hyperparams, and now we can basically do this thing 10x times faster and better than the algorithm you guys been working on for the past 5 years" which can be quite baffling. (I am not trying to say this is wrong though, there's a limit in what we can achieve with conventional programming and ML is there of that and it's there to stay)
On a side note, I don't think we are nowhere near to be using this type of technology in games. When a paper claims the algorithms work at interactive rates (so not real-time rates), it means maybe 10fps minimum. In the conclusion of their paper, they mention that their system in its unoptimized forms takes half a second for rendering on a RTX 3090 GPU, which could be improved with appropriate use of G-Buffer. I also think most people mistakenly believe that this is some kind of company putting forward a "proof of concept" to be implemented in games. They are not, the three are all research scientists working for different firms (two of them are from Intelligent Systems at Intel)
Imagine if they had used HD images of Los Angeles to do this.
Los Angelos smells
Too bad it's impossible to get HD images of Los Angeles...
/s
@@Chad123-g3d ehhh not really
@@quangos9455 ehhh yes really
@@umamifan ehhh yes really
A reason for the green color may be that the windows of the Mercedes just had a green tint.
Finally, using cutting edge AI technology, we can turn GTA 5 into GTA 4.
lmfao
ikr it looks worse
@@arekkusu0o it looks worse and similar to GTA4, because as they said, they used images from irl germany and they were washed out grey. If they had used images from California, it would be more colorful. And they did show a better colored version at the end of video around 7:00 I think.
Finally, someone that understands and can see the huge difference. Sarcasm of course in case you didn’t notice as you didn’t in the video.
Also have to remeber these aren't 4k cameras these are basic dashcams and photos from germany. Strap on 4k cams and go to LA and its a whole different story
This is what GTA 5 will look like after rockstar rereleases it for the 88th time in 2167
This is the perfect example of the difference between realistic and Beautiful.
7:47
I disagree, gray is REALLY beautiful. It's one of the things I miss in my small city coming from e medium city.
@@TheEmolano no gray is sucks especially if it's a car color
GTA V is neither
@@Nothing-xw4tf It's okay. You'll understand the beauty of humble colors when you're older.
This video is 2 years old. Has it ever been released as a useable model? Is there a way to access & use it?
nah they just baiting for views all fake
Unfortunately it hasn't been updated since the prototype phase and a month ago Intel announced on Github that they are discontinuing the project. Sucks because it's a pretty cool idea. Hopefully they'll start a new project like this and make it commercially viable
Some people are memeing in the comments, but genuinely, my jaw's a bit agape. For most of the footage altered by the software, it genuinely looks like a google street view camera, moving in front of me... although with higher camera quality, and it feels much more realistic to human sight, rather than simply a camera's footage. It's genuinely astounding to me just how amazingly real it looks! I never thought photorealism could look realistic, there'd always be that uncanny valley to it, but... this video changed my mind on that, that's for damn sure.
Absolutely incredible!
The game looks like a smoother GTA4. Rockstar could've done this but didnt because its bland. Games have style. Gta5s style is west coast 90s. Supposed to be like a Tupac video. And I wouldnt even say it looks realistic. Real life is alot more colorful than this especially in the US, especially in a city like LA. Looks like a dashcam from 2003. It's somewhat impressive sure but then again rockstar could do this if they wanted
@@jaystuder4458
Rockstar right now could make a GTA 6 that looks similar, but in 2013 they could not come close to this.
Not to mention this tech does not actually render any 3d graphics, it just uses AI the generate the frames. Completely different.
@@JonDoe-uq1mk people made mods that looked almost this good when the game first came out rockstar is a billion dollar company with millions of workers and they could definitely do this they chose not to because it just doesnt look appealing
@@jaystuder4458 weren't the mods just making gta look like the fire department went postal and just sprayed all the roads with water?
I wonder if the results would be more accurate if you used images of Los Angeles in the dataset, to more closely match the setting of GTAV? This is fascinating stuff.
If only there was a dashcam data bank in LA
Can confirm the lighting is a bit more white/yellow, not green, here.
We tend to not have a lot of overcast days, most of the time the skies are clear, and we're right off the ocean, too.
It's not a huge deal but while neither quite match the true lighting in LA, GTAs is a bit closer while the mod's realism is a lot better.
@@KingNefiiria it’s not a mod tho
@@luc9450 shut up you know what I mean
@@KingNefiiria didn’t mean to come off as rude, sorry mate. Was just trying to inform
Makes video about Photorealism
Uploads it in 720p
Looks great, but could really use some extra pixels xD
And the more frames... I mean, we are seeing less data because of the low framrate lock.
I suspect that the dataset German city streets is 720p at most (they said "automotive quality", which is a nice way of saying not very high quality at all). For higher resolutions, you would need higher res reference data.
@@no1DdC More likely it's 720p for game performance while the enhancement is running and recording at the same time.
@@VincentNacon I highly doubt the enhancement is running on the same machine. It's also likely not running in what gamers would consider real-time. "Interactive frame rates" is a nice way of saying "far less than 30fps", just like "automotive grade quality" means low-res.
this thing is still in its infancy, give it a year or two and watch how crazy it can get
That's the reason why i always thought why GTA 4 seemed more realistic to me than GTA 5 in terms of graphics and the driving physics.
the cars driving camera wasn't in the center of the car it was more to the left.
and the colors of the city when everyone thought its dark because the game had a darker story and thats how niko was viewing liberty city. it turned out because of how GTA 4 was the first HD GTA game and not like the old 3D GTA games before, it would make sense if they actually tried to make it looks closer to real life back then.
i find it hilarious that the photoreaism thing makes it look more like gta 4.
ive been saying it since gta 4 came out, that game just had such a realistic vibe to it. it was on another level.
Ok
Exactly. If you removed that weird resolution thing, made it clearer, it would look A LOT better.
When a game makes you feel hot and cold based on colours, that’s a real looking game.
It was embedded in the physics engine as well. Drive a car into a wall and GTA4 and then do it in 5. The contrast is stark. GTAV with GTA4 physics wouldve been the shit but people whined about it being too realistic
@@isaacsrandomvideos667 like u said, EXACTLY!!
gta 4 has extraordinary graphics, its just the resolution that was aged. the graphics themselves and even more so the colours, were just special. that world felt real when i first played it. i was in absolute awe!!
So that's what I've been clicking those captchas for all this time?
You know what, I think you might be on to something here...
Effectively yeah. It's a weird concept to prove you're human by teaching the robot what humans see.
But automatic cars would be quite difficult to implement without it knowing that the leaf that crossed it's sensor is not something worthy of an aggressive lane change to avoid an accident.
literally yes
yes, actually.
No I guess cause when you choose the wrong images then you are not allowed to proceed,that means the AI already has the info of what the correct images are.
That is disturbingly realistic, even not taking into account that it is an almost 10-year-old game
AHHHHHHHHHHHHHHHHHHHHHH
Swear this is an old game and its still to this day a hit.
@@dougroe4042 That’s what rockstar thinks too
@@dougroe4042 Online is a hit and shark cards make money. Single player has been dead after launch like every other *R game
@@Legion849 nahh man people bought rdr2 just for the story mode and many people still play it today
How's the project going people, keep us updated
I always thought smoother, less detailed roads were way more realistic. It just makes everything feel way bigger, and it's not like you can actually see every little rock on the road when you're sitting in a car.
In other words: too realistic
Enable motion blur, you won't see details while moving
@@Sponge_Bob_Square_Pants You don't really see the details while standing still though either. At least not nearly as much as the original textures show.
@@BRZguy Enable TAA somewhere
makes everything in RDR2 look blurry
Well from what o know
Los Angeles roads are way more "detailed" with potholes and cracks than Los Santos
(The network was trained on german roads)
And like real driving you don’t look at the texture of the road too close
Colors and reflections are the important aspect here for realism
720p...
:(
in 720p the game was already running at 20 fps, imagine 4k LMFAO.
69th like
Running intel gpus 😂
Did you notice the jerky controller input? Why didn't they use a wheel, or stiffer thumb, or mouse, or pong paddle? They ruined the real side for me, like the driver had a wasp in the cab!
720p and compressed af :(
nodding along like I know anything they're talking about LOL
It's very straight-forward stuff. They tell computer "try creating random filters until it turns pic 1 into pic 2" and eventually it works. That's all neural nets are, essentially trial and error.
@@themodfather9382 lol its because they use so many big words and abbreviations. at some points I just found myself dozing off and hearing TV static 😂😂
@@ROADHouse702 kljklklj
@@themodfather9382 its not straight forward if more than 99% of the people in the world dont know this shit.
Same well i guess it time to get deep in this field in order to gain more knowledge and opportunities .
This is why GTA IV looks like the most realistic entry in the series
Title of the paper: How to turn a GTA game into a Matrix game: a deep learning based approach.
It astonished me that the bleak, grayish camera filter makes GTA 5 looks grounded with reality just like the _COPS_ TV show than the typical blockbuster Hollywood movie.
That’s why gta 4 sometimes can still hold up
play this in another tab
th-cam.com/video/fXTn2gSG7es/w-d-xo.html
Come back, mute and start here 0:15
Yup, I think the GTA V og graphics work better because they purposefully used color to make it look cinematic like a hollywood movie
@@mortalmannequin4091 especially at night lol, when the poor draw distance isn’t noticeable
It doesn’t though.
The color tint is due to them using a dataset made in Germany, with different sun strengths. Imagine this tech, but with Rockstar actually driving through LA with high-end camera's.
Go rewatch the last 30 seconds, when they talk about vistas.
The license plates are even switched to EU plates
@Oscar Santana did you meant "Germany is a third world country"? Lol
I'm sorry but this is complete horse shit. Sunny days look the exact same as in the US, apart from solar angle.
It's like how Mexico is always portrayed as red in movies but there is no difference. Same as Germany, there's no difference
@@Cratoz911 Sir, please keep facts and logic away from the TH-cam comments section plebs.
Something people dont realize about photoreal images is that reality is often far less exciting to look at than fiction. Colors are washed out, textures dont pop as much. Photoreal games aren't a good idea save for a couple use cases like simulators. Games are meant to tell a story and visual interest is necessary for that. Making a game like GTA or Cyberpunk look real subtracts from the overall experience. Its a facsimile thus it shouldn't be real. Nonetheless, this is incredible work and its amazing to see. I'd love to see technology like this put to use in something like MSFS or Assetto Corsa.
Finally someone reasonable. So many people circlejerking about realism in the comments yet they don't realize that games looking like this have been possible for a long time, just most people actually wouldn't play a game this ugly.
No offence but your comment tells me you need to get out more. So many people these days, especially gamers live their lives vicariously through television, computer screens and dont realize the real world is actually much more colorful and sharper than anything we can experience through a screen. As for games, we still got a fair way to go before it can come close to replicating reality.
@@LevelEarth2021 they are sharper and more colorful but in a different way if you get what I mean.
It's so realistic, it fixes broken American roads with efficient, clean and well maintained German roads.
Edit - For complete morons out there who need to psychoanalyse this post. It is a jab at German efficiency and the generalisation thereof from the early 1900s. For those of you too dense to understand, Clearly not every US road is bad and not every German road is good. If you watched the video you will get that the roads were smoothed out by the German town footage and the streets in the game GTA 5 were shoddy. Hence the joke that German efficiency fixed the roads. Nothing more, nothing less. 800 people understood the joke, but you had to go and be special didn't you?
if you knew how some roads in germany look like lmao
@@Antoni1018 Not saying all, but from the ones I saw, they were much nicer than L.A Streets I can tell you.
@@ninjapants7688 ye i feel you
@@ninjapants7688 Can confirm, lived in LA for most of my life.
@@ninjapants7688 areas that have bad governments have bad roads, it's a fact. Just look at Michigan lmao.
FINALLY, Someone who understands that realism isn't all about hyperdetailed textures and intense lighting. The crazy overdone rendering is what makes very high quality games just not look real. When you want to set a mood or tone then realism isn't needed, but if you specify that you want realism then you must cut back on the texturing and details and lighting.
Edit: People in the replies keep saying that, "no, the other looks better" you are fools. Not because your opinion is wrong, but because of your reasoning. The new one shown is completely realistic visually besides the dreariness of all of the visuals and even that is debatable because real life often does look like that with overcast and cloudy/slightly foggy days. All of the graphical changes in the new version looks like something you could see in real life 1:1 while the original is clearly a game. It's not about what looks better or which one you prefer, it's about making photorealism look as close to real life as possible, and the new version definitely accomplishes that.
Actually textures are what give that photorealistic look, details are very important too, to make the world feel alive.
On the other hand, over-the-top lighting and absolutely exaggerated post processing makes everything look awful and fake
Also motion doesn't get enough love :( (animations and physics)
It's why when I played the Matrix games back in the day vs other "realistic" games of the time, the Matrix seemed more realistic
@@danill4381 Yeah, they should have really trained the algorithm on SoCal streets
This isn't realism. It's suppose to look like it was recorded by an early 2000s dashcam. Real life is much more colorful.
huge oversimplification of how video games are designed lol
Me: watches video
My PC: You forget a thousand things everyday, how 'bout you make sure this is one of em
underrated lol
lolol
My pants are full of poop :)
@@بِلَادٱلرَّافِدَيْنبِلَادٱلرَّ my pants are full of big balls and a magic stick
Oh my god I thought that was real footage in the thumbnail. It’s crazy how the color makes a big difference. Reminds me of the Matrix Demo
this is absolutely stunning.
But when they're explaining how they do it.... why do I feel like I'm watching inter dimensional cable on Rick and Morty
if you want to know more of this kind i recommend the channel ''two minute papers'' they explain their works on machine learning just like this. Maybe gives better idea :)
"We pass the G-Buffers to multiple convolutional network streams and fuse the streams again. The resulting feature tensors are further processed by residual blocks, which output tensors at multiple scales."
@@MatthiasPitscher Apply the tantulus generator with static polarity to the paraphoretic bipolarized grid, then reionize the isolinear tactical chips to get the stational compensators aligned with the multisynaptic structures.
@@chaoticascendency7763 LMAO
@@chaoticascendency7763 this reminds me of the steps to make Plumbuses
This is actually insane! It's like I'm watching actual dash cam footage of the real world!
Did u watch the matrix unreal engine 5 demo u should
Naaahhh
Russian dashcam videos
@@Chad123-g3d This looks better than the Matrix
@@Mr.Gribble not really but it has the potential
now this is it! not just some wet road fetish lol
This is GTA 4
@@houghwhite411 Lol no
@@underhillat lmao gta iv's color grading is much more realistic
@@houghwhite411 Not even close wtf
@@houghwhite411 u high on drugs
I feel like a lot of the confusion in the comments comes from the fact we're talking about photo-realism and not hyper-realism
The notion that AI research computer scientists are competing to see who makes the most photorealistic GTA V graphics mod is so appealing to me
Then they're behind 😂
@@karlsmink I see
"what is my purpose"
"you desaturate, blur and blue/green balance"
"oh my god!"
good one anon
Well you clearly can see there's a difference in lighting/shading and thats hard and changes a lot in how a game looks.
@@ZeroSleap It's a Rick&Morty reference.
@@AdamHKatona Shit i missed it .*Woosh* shit there it's gone :P
@@AdamHKatona god you make me sound so stupid when you say it out loud...
"The missile knows where it is because it knows where it isn't"
"By subtracting where it is from where it isn't, it obtains a difference, or deviation"
I recognized the voice from somewhere... thank you.
Cringe. Please shut up.
@@7yk041 yep, so cringe that 152 people liked it. My bad
@@7yk041 ok troll
We should compare this to GTA6 in 2025
it is obviously still in the very early stages but dammn it is impresive. The future of videogames is bright and very realistic.
I wouldn't say bright. I'd say dull with a gray/blue tinit. 😂 But definitely realistic.
@@skatman3278 It think it looks that way because the image they used had that green/blue tint. I bet that if they used a more vivid and colourful image, the end result would be much more vibrant.
@@roguescorner9042 yeah, totally. It looks amazing. I was just making a joke about the 'bright' comment.
@@roguescorner9042 agreed, the photo set clearly makes a difference as at the end you see a much more vibrant version of it made using a variety of city images rather than the mostly German cityscape set
bro it look so realistic it making me scary sometimes like just imagine a shoutout in gta with those graphics
That's pretty awesome! Now all you need to do is get a better camera, mount it outside the car (not through the glass window since it gives that color tint look) and record the real L.A. place in HD or 4K.
watch until the end
@@BottomOfTheDumpsterFire Um...??? He said he used captures from around the world, but GTAV is heavily based on L.A. in USA.
@@VincentNacon No, I mean that the colour tinting thing is removed at the very end, and it also removes the tint that GTA added for some reason.
@@BottomOfTheDumpsterFire Yeah the tint is gone because he used different captures that balanced out the colors.
@@BottomOfTheDumpsterFire it still has a weird tint to it imo.
*Alternate Title:* How GTA V looks through a Depression Simulation.
Yea, it looks dull
Welcome to real life my friend.
@@Mr.Reality :(
Like gta 4
it looks like gran turismo 4 btw :D
I'm sorry but Los Angeles, Los Santos anyway that city doesn't appear really sad depression carrier but per contra it's really cheerful and warm.
they have to do this trained on realistic dashcams (or just cameras in genera). But it CAN'T be phone cameras, it has to be cameras that capture color and light correct.
Having this with a VR headset and hand controls would be like a dream. The images are clear enough to feel real but are slightly off to feel like a dream.
i would do very unspeakable things
@@jerehmjr 🤣🤣😳😳
@@jerehmjrI've done some very unspeakable things in VR and it's amazing.