@@billyccall5774 photos/videos from dash _cameras_ aren't photo like? Anyway you're missing the point, If there were a different looking image set it were trained on, it'd look just like that set instead. Dash cam footage is largely available and very complete.
The problem is that it doesn't fit GTA 5s location or art style, I could've easily mistaken this for GTA 4, as that game is way more washed out and visually boring like the photorealism captured from Germany.
It's one of the reasons why old valve games like half-life 2 could pass for a low quality image if you squint. They're great at making colors look realistic, even if the models and textures were low quality. Rockstar has also been getting better at this lately with RDR2.
This is what treyarch needs to learn about black ops. I see black ops and think everything looks too bright and oversaturated, and that degrades the graphics.
It’s amazing that no matter how real things get, at junctures of advancement you always notice something that’s off that you didn’t notice prior to the leap.
The first dataset with the dash cams looks so much more real. I think even though the more vibrant one might be technically more realistic I feel like it’s a bit too vibrant. Maybe it’s just me but I don’t see things that vibrant. Like it’s a different between looking at something and taking a picture with a good camera that captures all the colors. That’s why lean towards the dash cam more because things look cartoonish when they’re vibrant.
Mine was when the main winding was of the normal lotus o-deltoid type placed in panendermic semiboloid slots of the stator, every seventh conductor being connected by a non-reversible tremie pipe to the differential girdlespring on the ‘up’ end of the grammeters
Omg same! my absolute truth rule to follow is that hydrocoptic marzel vanes and an ambifacient lunar wane shaft are a critical part of the normal lotus o-deltoid type placed in panendermic semiboloid slots of the stator, every seventh conductor. Otherwise connected by a non-reversible tremie pipe to the differential girdlespring for maximum efficiency during combustion of the final rendering.
Maybe GTA 7, you could theoretically make the next GTA already look this good but very little people would have computers fast enough to run it and it GTA has to run on consoles. GTA 5 is already coming up on 8 years old, and GTA 6 really needs to come in like the next two to five years, maybe in 10-15 years for GTA 7 it could look like this and consoles of the day could run it.
@@ThePussukka No we know rdr2 is extremely realistic & almost perfect and gta 6 would have even more realism and it would probably be maximum realistic. So I think they gonna start a new series
Take a look at DLSS, to make 1080p images look like 4k images is actually crazy, and the fact that it can in certain cases make your artificial 4k look better than native 4k is even crazier. I mean, how the actual fuck you pick a 1080p image and simply add 6.7 million pixels of detail from nowhere accurately.
@@DrakyHRT word! Neural networks are gonna change everything and they've already changed a lot. Seriously impressive what they've capable of. I'm sure that future video game graphics will be rendered basically by machine learning in the future.
I dunno about that. If I understood correctly the lower polygon count in Vice City, would probably cause things to look bit too squarey, but I guess we can't know that unless it gets tested.
Wooowww... This is amazing. Makes the game look more realistic than any other mod out there (though it also makes it look like it's a camera footage from 2008)
Look at 8:00 for the proper result, using good reference pictures - representing a good camera. The first images is like from a low quality car camera - not great outside of limited story-use in a game...
You don't want photo realism. The game will become boring rather quickly. That's why all games are kept on a semi comic level even with super detailed textures.
You know what a lot of Developers do in error is that they want to show off their textures so they blow them out of proportion and get the scaling wrong.
I think the biggest roadblock to good photorealism is that sometimes people don’t realize that reality isn’t always so beautiful or crisp. A 4K texture is just a texture. Depending on distance in reality, colors meld together, and everything isn’t so bright. It’s the imperfections that make something look photoreal, not the lack of
@@jenkathefridge3933 The point the Original Commentator made was that in Life not everything is crisp. Sometimes objects can lack details and such, but if you have 4k Textures the Details often still stay visible even from afar, which doesnt always happen in real Life.
In NVR you can set Less, Default, or More puddles. I think it’s the same with NVE. But all the “RTX Graphics in GTAV” video creators usually use the More Puddles option
@@deus1784 No not at all the overall technology is amazing and putting this is strictly false, with a bit of tweaking the system can create sharpened high res image.
@@_vallee_5190 You misinterpreted that as a negative while Deus was in fact trying to use it as a positive, it truly looks like we're looking through a dashcam
Even the "vistas" version looks less realistic. Not 100% sure why and maybe it's just me, but it feels like because it has more color, the aliasing other artifacts art more noticeable and it doesn't look as real as the desaturated dashcam version.
It's very possible to do this in real time. It's just that it's ugly as hell and most companies would rather make pretty visually appealing games than ugly realistic games.
@@phelan8385 You don't need this specific image enhancement model to achieve these results. They had techniques in like 2015 that ran just fine and delivered an insanely realistic experience. As the person you replied to said, it won't happen because people will complain that it looks ugly. Life is ugly 99% of the time.
@@xthinkfast No, it's literally not a mod. You can't install this to your game. Mods are used to modify the game in real time, this doesn't do that. 10 seconds to their page would have told you this, but hey I guess it's easier to be stupid than to be right.
The real hot take is that while it looks more realistic, it also looks uglier. Reality is ugly, I wanna look at the overly saturated base GTA 5 instead. lol
I would love to see how this program "enhances" the NPC characters walking around in the world. What do their faces look like when looking at it close up after being trained.
There is a person walking right near the end of the video. Can’t really see the face though. I’d imagine the training dataset probably blurs out faces anyway?
@@CJAM03 as a person thats lived in LA m whole life there is some places that look a bit run down or kinda of ghetto like grove street but with more apartments but it's mostly potholes in the streets and um... well potholes ^-^
Which arguably makes it photorealistic, as to get these shots you yourself would be behind the windscreen, probably with a dashcam The funny part is, while driving in a straight line, my mind is totally convinced I'm watching a dashcam, but the second the car turns, the illusion is broken. I love video games :]
They used a model trained via photos taken from a dashcam with a windscreen obscuring it. If they used a different camera and took different reference photos (something that a videogame studio's art department could manage), it would produce results that look like whatever pictures they provided. I think the really interesting part here is that they don't necessarily need to use a "better" camera or "better photos"... An art department could make artistic decisions when producing a reference photo data set; color settings, camera quality, the textures and colors and surface qualities of the objects in photos, etc would influence the end result.
That might be more to do with the lack of actual interactivity in the methodology. Movement might be all it is capable of handling, hitting a sign or deforming a car is probably not possible without serious issues.
The model is trained on dashcam video frames so it will look like a dashcam video. Could look much better if gopro footages were used which I am sure is not available on this scale.
this is where games are going. not just AI behaviour and intelligence to allow them to understand and act based on your natural speech (like the games that the main character plays in the movie 'Her') but also stuff like this that makes the game look damn near real. this might even be a reshade mod in 5-10 yrs..
I'm no engineer but seeing how many processes are necessary in order to achieve the end result I think the computing power of consumer end PCs won't be able to give such an output for a little bit longer. It's doable on really beefy machines, but I doubt it's done in real time otherwise the framerate would be absolutely horrendous to look at for extended periods of time.
I think the problem is with the method itself, maybe it can't handle 1080p+ images yet, or maybe it takes too much processing to do, as the game was running in 20fps.
It's an early tech. I'm sure they will be able to render in 1080 and more in the near future. But to expect something that looks this good to not have limitations is crazy. There are always limits on tech until they are refined. We all just gotta calm down and be patient lol
That's the trick with just about every "photo-realistic" claim. Blurring everything. Your brain fills in the gaps to support the illusion and you can't point at anything in particular that doesn't look realistic because it's all blurry. And if you try to point this out, they have the copout excuse of "Oh, we said PHOTO realistic. As you can see, this is blurry just like a russian dashcam". Like, dude...
It's very straight-forward stuff. They tell computer "try creating random filters until it turns pic 1 into pic 2" and eventually it works. That's all neural nets are, essentially trial and error.
@@themodfather9382 lol its because they use so many big words and abbreviations. at some points I just found myself dozing off and hearing TV static 😂😂
they have to do this trained on realistic dashcams (or just cameras in genera). But it CAN'T be phone cameras, it has to be cameras that capture color and light correct.
This is what ENB/graphic mods creators should be doing instead of oversaturating the colors, overusing ssao and flooding the floor and making it look like a damn mirror, and also try to sell that shit for 10 bucks a month
@@ThirstyEdits maybe screen space reflections (SSR) but not rtx, they just make the game look like shit with all of that water and they don't show anything new
Imagine if: - GTA V was made in 2021, raising the graphics standard of the base game - The AI dataset was made with a 4K camera instead of a LQ dashcam - The AI dataset was recorded in Los Angeles instead of Germany, matching GTA V's setting The result would be insane.
@@arekkusu0o it looks worse and similar to GTA4, because as they said, they used images from irl germany and they were washed out grey. If they had used images from California, it would be more colorful. And they did show a better colored version at the end of video around 7:00 I think.
Also have to remeber these aren't 4k cameras these are basic dashcams and photos from germany. Strap on 4k cams and go to LA and its a whole different story
Did you notice the jerky controller input? Why didn't they use a wheel, or stiffer thumb, or mouse, or pong paddle? They ruined the real side for me, like the driver had a wasp in the cab!
@JET0802 I didn't get them either. Los Angeles is sunny and colorful enough to really look like that. But they come um with a German grayish landscape. Wtf??
If they make a simple enough software it can become a Instagram/tiktok trend lmao. Input your images and the engine will render them to look as if you were inside the game.
This is why GTA 4 still looks real sometimes despite having lower fidelity graphics, the colours are more true to life. Anyway, I achieved this by just upping the green tint on the TV, and it made GTA 5 look way more lifelike and real. It doesn’t make it go green it just makes the colours look more natural like this video.
Exactly if you go back and even watch the gta 4 trailers the whole color system gave that game such an realistic feeling. I live in Germany and here in winter it very feels „grey“ and in summer „green“ just exactly like in this video. The matrix unreal engine demo felt also so realistic I think because of its „green“ colors
The colors in this video look extremely unnaturally green to me like they added a Matrix color filter on it. There is also too much greenery in general when LA does not have nearly that much vegetation that is so green. IMO although the original looks a lot more true to real life simply because it used LA for reference unlike the AI which only has data from Germany. To me the new images do not look realistic at all.
Go outside during spring or summer. Look at some grass and flowers. You might start to realize that the real world can actually be beautiful, and that “gray and gritty” doesn’t equal “realism”.
@@kalecccxi333 all of you are expertly wrong. The closest source to life like realism is Kodachromes. It has the sun exposure, the dark mix of colors, and the correct saturation unlike modern cameras that lack both frequencies.
I wonder if the results would be more accurate if you used images of Los Angeles in the dataset, to more closely match the setting of GTAV? This is fascinating stuff.
Can confirm the lighting is a bit more white/yellow, not green, here. We tend to not have a lot of overcast days, most of the time the skies are clear, and we're right off the ocean, too. It's not a huge deal but while neither quite match the true lighting in LA, GTAs is a bit closer while the mod's realism is a lot better.
I remember when Anti-Aliasing options first appeared as 2x, it could cut frame rate by 2. So in theory if we would accept 30 frames per-second again for a while, re-renderering a frame based on AI analysis might not be THAT mad of a technique.
i dont think there will be that much of a difference cause its rendering real time photos not a model so that will help but ofc 8gb of ram wouldnt be enough i guess 12 gb of ram should be good for it tho the game is highly doubted to run no more than 30 fps so yeah thats it if you ask me i guess the minimum requirement would be, 12gb ram GTX 1050ti tho its just an assumption
@@selamentor Yep. Plus while sandbox type game is really heavy on "continuity" comparison, imagine something slower, like adventure horror or even virtual found-footage game experience.
My third grade teacher: “quit putting ‘the end’ the end of your paper. It makes you sound dumb” These guys, obviously smarter than my entire hometown combined:
@@StereoTyp0 first how is that grammatically incorrect, just asking out of curiosity, since this is irrelevant to the point being made, because put "the end" is more a choice than anything else.
@@whyitmatters6906 "produces fewer artifacts", would be correct line. "Less" is used not supposed to be used with discrete nouns being counted. For example, if I said, "there were less people at the store", it grammatically implies that I'm referring to some measured amount, such as the mass of the people missing. It basically implies a strange observation such as, "there were 123.4 kgs less people at store". This reads as strange because it divides discrete units such as individual people. Conversely, using "fewer" with mass singular nouns is equally incorrect, e.g. "I used fewer salt to season the soup". Either way, this grammatical rule and the use of "the end" are both examples of a writing style that I would find unacceptable from a professional writer but be less offended to find in a presentation written by a professional engineer. Edit: accidentally a word.
Man they need to run a realistic physics mod because the jerky car physics are just about the only thing that makes it immediately obvious this is a game.
Effectively yeah. It's a weird concept to prove you're human by teaching the robot what humans see. But automatic cars would be quite difficult to implement without it knowing that the leaf that crossed it's sensor is not something worthy of an aggressive lane change to avoid an accident.
No I guess cause when you choose the wrong images then you are not allowed to proceed,that means the AI already has the info of what the correct images are.
I suspect that the dataset German city streets is 720p at most (they said "automotive quality", which is a nice way of saying not very high quality at all). For higher resolutions, you would need higher res reference data.
@@VincentNacon I highly doubt the enhancement is running on the same machine. It's also likely not running in what gamers would consider real-time. "Interactive frame rates" is a nice way of saying "far less than 30fps", just like "automotive grade quality" means low-res.
I think games will keep their game in the cartoonish realm so people can't abuse the system. And get a ton media hate on how video games kill people lol. Pretty sure we will be living in a virtual world by 2040 :P.
TH-cam really did you nasty with lossy compression. the images on the site are strikingly photorealistic, to the point that looking back at GTAV you can immediately tell what looks off. That game that used to represent a standard for photoreal graphics in AAA defeated so mercilessly is jaw droppingly awesome. Though one minor complaint I would put forward us the cityscapes color washing out GTA's vibrant LA theme. perhaps some LA _esque_ colorgrading on the training material or your result would give a more appreciable image. Mappilary doesn't suffer from that discoloration but I feel its result isn't as convincing
Well it is a photorealistic enhancement. By re-rendering each frame, it naturally loses some of the vibrant colors that were deliberately decided on when coloring the scenes of the game.
@@cane870 so would you prefer to watch movies without color grading ? plus you've completely missed my point. the discoloration doesn't come from a place of photorealism but from the limitations of dash cam grade footage. I'm saying that fixing it would make it look better, not more photorealistic.
I don't find it that impressive tbh. I think rockstar could make it look like that if they wanted if they tweaked the textures (the most obvious would be to make the road texture have less contrast), car reflections (they could use raytracing nowadays) and tinkered with the color grading. However, GTA was never aiming to be 100% photorealistic. While it's very detailed and quite realistic, it always had an art style. Also, remember it's a 2013 PS3/X360 game. Like, it's good but not THAT groundbreaking. If they used it on GTA3 level graphics and get these results that would be way more impressive. But it doesn't seem to add in much geometric detail apart from the vegetation.
well really it's not defeated, because gta v oem graphics look better, but that was the point the colors are more vibrant, and everything is meant to be ultra realistic when in reality, everything is a bit more depressing. This program did a great job at somehow making things look more like a HD police dash cam than graphics in a video game.
i find it hilarious that the photoreaism thing makes it look more like gta 4. ive been saying it since gta 4 came out, that game just had such a realistic vibe to it. it was on another level.
It was embedded in the physics engine as well. Drive a car into a wall and GTA4 and then do it in 5. The contrast is stark. GTAV with GTA4 physics wouldve been the shit but people whined about it being too realistic
@@isaacsrandomvideos667 like u said, EXACTLY!! gta 4 has extraordinary graphics, its just the resolution that was aged. the graphics themselves and even more so the colours, were just special. that world felt real when i first played it. i was in absolute awe!!
This would look realistic if our eyes saw the entire world around us with the quality and resolution of a dash cam on a car, because that's the source footage the neural network used as the reference. The real world doesn't look like that at all. So no, this is not "realistic", this is just playing GTA 5 with a dash cam filter or shader on top of everything, replacing the textures and lighting FX. Interesting and promising, anyway.
I've been thinking about this a lot lately: at this point in technology, I think the least realistic aspect of video game graphics is just the oversaturation and sharpness of everything.
Add to that better physics engines, capacity for higher asset density, and more realistic AI. The physics engines in games still make everything feel too clunky or weightless, most open world games have large maps but are often mostly comprised of shell assets which are static and can't be explored or interacted with, and interactions with most NPCs still remain immersion breaking imo.
It makes it more pleasing to look at. The real world itself is beautiful in its own right but more boring to look at than say an 8k rain enhancer script in gta 5
Mofo how do you want it to look? Dashcam footage is realistic, it is LITERALLY real. If it looks like real cam footage it is realistic, just go outside bro.
Yes and no. We already deal with a bunch of people who don't even know how to model anything bespoke, going into archviz because the stock models and rendering engines are cheap and good. The low bar of entry lowers the overall value of the work, as more people flood the market offering their services (though this is visually offset by the fact that stock models and rendering engines are so good now). I observed the same issue in the field of photography - cameras got cheaper, better, smaller + the internet started offering endless tutorials and free stock (unsplash, pexels, etc) = hard to find well-paying work for everyone, because Joe Schmo can show up at the door and do it for next-to-nothing + more and more agents shift to just doing it on their phone. A lot of stuff that used to be photographic jobs - moved to 3D, where it's easier and faster. A lot of 3D also moved overseas, where a guy from India can do 3-5 jobs for the price of 1 in the west. Etc etc etc. Basically what I'm saying is - it's your own demise. Fun at the start, "yay tech!" and all that, but ultimately you'll need to change professions to put bread on the table because at some point this tech will make it impossible to make money anymore. Short-term thinking vs long-term reality.
@@TheUltimateBlooper A low barrier to entry is great. If your work is reliant on there being a higher barrier of entry, then maybe your work is shit in the first place? After all you're basically admitting it's just a synthetic barrier that is helping you. We're going to end up making the art accessible by tons more people with much less work requires, and that's only a good thing.
@@TheUltimateBlooper this is ludicrous logic. By that logic, there should be zero professional photographers. Tutorials and demonstrations mean absolutely nothing if you are incapable of doing it as a client, It's the same reason why TH-cam has videos showing how designers make their products. Sure, someone could go out and buy all the materials and tooling needed and recreate it, but the artisan relies on the fact that people's time is more valuable than simply paying the right person for the job
@@TheUltimateBlooper a bit agree with you. Archviz videos used to be super expensive and now plummeted because Lumion. But, just like another job, we need to step up our efforts harder than ever using these new technology. And don't put all of your eggs in one archviz basket, you can do TH-cam, artistry, or whatever
Some people are memeing in the comments, but genuinely, my jaw's a bit agape. For most of the footage altered by the software, it genuinely looks like a google street view camera, moving in front of me... although with higher camera quality, and it feels much more realistic to human sight, rather than simply a camera's footage. It's genuinely astounding to me just how amazingly real it looks! I never thought photorealism could look realistic, there'd always be that uncanny valley to it, but... this video changed my mind on that, that's for damn sure.
The game looks like a smoother GTA4. Rockstar could've done this but didnt because its bland. Games have style. Gta5s style is west coast 90s. Supposed to be like a Tupac video. And I wouldnt even say it looks realistic. Real life is alot more colorful than this especially in the US, especially in a city like LA. Looks like a dashcam from 2003. It's somewhat impressive sure but then again rockstar could do this if they wanted
@@jaystuder4458 Rockstar right now could make a GTA 6 that looks similar, but in 2013 they could not come close to this. Not to mention this tech does not actually render any 3d graphics, it just uses AI the generate the frames. Completely different.
@@JonDoe-uq1mk people made mods that looked almost this good when the game first came out rockstar is a billion dollar company with millions of workers and they could definitely do this they chose not to because it just doesnt look appealing
The competitors aren't trash per se, they're just processing the images. These guys are pulling object data from the game engine to tune the process. I'd imagine a game dev could work an engine like this into their game. Heck, rather than use libraries of dashcam footage, Rockstar could literally pull some 4K or 8K camera footage from Los Angeles themselves. Also, imagine having an on-the-fly FaceApp-style filter applied to the characters to give them real face replacements.
@@GiuseppeGaetanoSabatelli it's awesome technology! As a proof of concept I think it has a heap of potential and I'm keen to see something like this implemented to games via GPU similar to DLSS and ray tracing. don't worry my comment on the competitors was purely satirical. I just think most of these companies need to be able to explain and demonstrate in layman's terms. It just overwhelms and alienates a solid portion of the audience.
@@GiuseppeGaetanoSabatelli Personally, I didn't interpreted the competitors as being "literally" more thrash. This video is simply a demo to support their research publication, and the goal for research publication is to convince that your proposed solution is novel and effectively solve complex and relevant problems compared to other methods that already exists. So of course you will try to demonstrate that you were able to improve from other previous related work. And I think what amused me the most from reading this comment is the fact that there is a dramatic increase in the amount of papers using Deep Learning instead of manually finding better algorithms to solve quite complex problems, and they can be more or less summarised like this: "We chose an architecture like this, found these hyperparams, and now we can basically do this thing 10x times faster and better than the algorithm you guys been working on for the past 5 years" which can be quite baffling. (I am not trying to say this is wrong though, there's a limit in what we can achieve with conventional programming and ML is there of that and it's there to stay) On a side note, I don't think we are nowhere near to be using this type of technology in games. When a paper claims the algorithms work at interactive rates (so not real-time rates), it means maybe 10fps minimum. In the conclusion of their paper, they mention that their system in its unoptimized forms takes half a second for rendering on a RTX 3090 GPU, which could be improved with appropriate use of G-Buffer. I also think most people mistakenly believe that this is some kind of company putting forward a "proof of concept" to be implemented in games. They are not, the three are all research scientists working for different firms (two of them are from Intelligent Systems at Intel)
It's so realistic, it fixes broken American roads with efficient, clean and well maintained German roads. Edit - For complete morons out there who need to psychoanalyse this post. It is a jab at German efficiency and the generalisation thereof from the early 1900s. For those of you too dense to understand, Clearly not every US road is bad and not every German road is good. If you watched the video you will get that the roads were smoothed out by the German town footage and the streets in the game GTA 5 were shoddy. Hence the joke that German efficiency fixed the roads. Nothing more, nothing less. 800 people understood the joke, but you had to go and be special didn't you?
"It looks dull and like a dashcam"
Yeah no shit that's what it was trained on
Wonder how many comments saying that line i can find here. Probably a lot, but anyways, tbh this video was pretty darn cool, dashcam or not
So it's not "photorealism" is it is "dashcam realism"
@@billyccall5774 photos/videos from dash _cameras_ aren't photo like? Anyway you're missing the point, If there were a different looking image set it were trained on, it'd look just like that set instead. Dash cam footage is largely available and very complete.
nice pfp
The problem is that it doesn't fit GTA 5s location or art style, I could've easily mistaken this for GTA 4, as that game is way more washed out and visually boring like the photorealism captured from Germany.
I absolutely understood nothing, but it looks great
Lmfao 🤣
Same
Lol
Same
It actually looks much worse, but also more realistic. I never noticed how ugly real life was before.
Him: Perceptual Discriminator, G-Buffer Encoder, ReLU
Me: *eats Dorito* Yes, yes of course...
"i like your words magic man"
Write that down, write that down...! It's all coming together now!
@@Mystixor Literally comics that make fun of daily life and somehow make it into something that's actually funny 😂😂😂
Swag jesus The Bromans are planning to capture you please hide
I understood that reference.
This is the reason why Gta IV felt more realistic than gta V.
Fr
.
100% agree
Also GTA V's vivid color pallette was likely an artistic choice in sense that Los Santos is supposed to be a kind of bling bling uplifted lifestyle
Came here to say this
“Just adding more lighting doesn’t give it better graphics” is what this video screams to me
It's one of the reasons why old valve games like half-life 2 could pass for a low quality image if you squint. They're great at making colors look realistic, even if the models and textures were low quality. Rockstar has also been getting better at this lately with RDR2.
This is what treyarch needs to learn about black ops. I see black ops and think everything looks too bright and oversaturated, and that degrades the graphics.
Ya, just because your game looks PRETTY doesn’t mean it looks REAL
@@theioncow18 just play cod4
or water
help i am under the water
It’s amazing that no matter how real things get, at junctures of advancement you always notice something that’s off that you didn’t notice prior to the leap.
This video finally made me realize why photorealism will never truly work.
Because everything will end up looking like a LiveLeak Dashcam.
The first dataset with the dash cams looks so much more real. I think even though the more vibrant one might be technically more realistic I feel like it’s a bit too vibrant. Maybe it’s just me but I don’t see things that vibrant. Like it’s a different between looking at something and taking a picture with a good camera that captures all the colors. That’s why lean towards the dash cam more because things look cartoonish when they’re vibrant.
So, it's basically a mod that makes Los Santos look just as depressed as my life does? Fantastic.
My favorite part was the six hydrocoptic marzel vanes and an ambifacient lunar wane shaft which prevented unwanted side fumbling.
Same thought!! xD
Mine was when the main winding was of the normal lotus o-deltoid type placed in panendermic semiboloid slots of the stator, every seventh conductor being connected by a non-reversible tremie pipe to the differential girdlespring on the ‘up’ end of the grammeters
Omg same! my absolute truth rule to follow is that hydrocoptic marzel vanes and an ambifacient lunar wane shaft are a critical part of the normal lotus o-deltoid type placed in panendermic semiboloid slots of the stator, every seventh conductor. Otherwise connected by a non-reversible tremie pipe to the differential girdlespring for maximum efficiency during combustion of the final rendering.
I wonder how far this has come NOW!!!!!
If this can be added into games in real time, we might have the next GTA 6 looking fully realistic
Maybe GTA 7, you could theoretically make the next GTA already look this good but very little people would have computers fast enough to run it and it GTA has to run on consoles. GTA 5 is already coming up on 8 years old, and GTA 6 really needs to come in like the next two to five years, maybe in 10-15 years for GTA 7 it could look like this and consoles of the day could run it.
@bahae eddine heard so from a classmate or what?
@@ThePussukka Yeah mods like this will probably exist. (For high end PCs)
@@ThePussukka No we know rdr2 is extremely realistic & almost perfect and gta 6 would have even more realism and it would probably be maximum realistic. So I think they gonna start a new series
Rockstar be like:
"GTA what? Naah nah dude gta V is the sh*t"
The video is conveniently 720p only
Me: *watches video*
My PC: You forget a thousand things everyday, how 'bout you make sure this is one of em
Edit yooo 340 likes omg
lol
kkkkkkkkkkkkkkkkkkkkkkkk
Broooo Hahaha
dude yeah, imagine running this in real-time. ooooof
@@Ripsaw460 you'll need nasa's computer
This literally dropped my jaw. Completely mind-blowing how good this machine learning algorithm is. 🤯
Take a look at DLSS, to make 1080p images look like 4k images is actually crazy, and the fact that it can in certain cases make your artificial 4k look better than native 4k is even crazier.
I mean, how the actual fuck you pick a 1080p image and simply add 6.7 million pixels of detail from nowhere accurately.
@@DrakyHRT word! Neural networks are gonna change everything and they've already changed a lot. Seriously impressive what they've capable of. I'm sure that future video game graphics will be rendered basically by machine learning in the future.
stop overracting
I am holding on to my papers!
Me too fellow scholar
what a time to be alive indeed
Imagine how this will be just one or two papers down the line
Make sure to squeeze that paper, very easy to drop them when seeing stuff like this
This style of grading would look amazing in a Vice City reimagining imo.
I dunno about that. If I understood correctly the lower polygon count in Vice City, would probably cause things to look bit too squarey, but I guess we can't know that unless it gets tested.
Not at all.. Miami is much more colorful
I think you're thinking GTA 3 / Liberty City Stories
Title: “Enhancing Photorealism Enhancement”
Video: 720p, 15fps, no HDR
Yeah, thanks Internet!
Still photorealistic
Wooowww... This is amazing. Makes the game look more realistic than any other mod out there (though it also makes it look like it's a camera footage from 2008)
im glad its not camera footage from some 7/11 security cam
Yes it looks like old porn
Gta IV momento
Look at 8:00 for the proper result, using good reference pictures - representing a good camera. The first images is like from a low quality car camera - not great outside of limited story-use in a game...
I like how the improved version just looks like GTA 4
exactly lol
Must be cloudy
That was way more real
lowkey germany looks a lot like gta4 sometimes
0% brand cars
0% upgrade skins
0% rain weather
100% realism
That’s fucking insane! Damn, we are closer to photorealism than I ever thought. This method could change the game and hardware industry sharply.
I think we are a long way from smooth 60fps + though. This systems seems to only work with P.O.V. I could be wrong, this video is way over my head.
@@andrewmurphy5310 it only works from the camera angle shown, as the networks wasnt really trained with other perspectives in mind. Still, amazing
You don't want photo realism. The game will become boring rather quickly. That's why all games are kept on a semi comic level even with super detailed textures.
this is like a teacher eplaining something "simple"
Imagine the kind of engine these guys can create with a big budget and enough time 😮 Rockstar should give you guys a call
for a second i thought that was real life
I genuinely thought it was real life.
You know what a lot of Developers do in error is that they want to show off their textures so they blow them out of proportion and get the scaling wrong.
I think the biggest roadblock to good photorealism is that sometimes people don’t realize that reality isn’t always so beautiful or crisp. A 4K texture is just a texture. Depending on distance in reality, colors meld together, and everything isn’t so bright. It’s the imperfections that make something look photoreal, not the lack of
If you put 4k texture on everything the game wouldn't be able to run at a high fps
@@jenkathefridge3933thats not the point.
@@TheBlueNeutron Then whats the point?
@@jenkathefridge3933 The point the Original Commentator made was that in Life not everything is crisp. Sometimes objects can lack details and such, but if you have 4k Textures the Details often still stay visible even from afar, which doesnt always happen in real Life.
@@anti1917 That is true
For once a realism mod that doesn’t just add million puddles and reflections
and oversaturated bikini girls for clickbait
too bad they didn't use realism examples of hoes
In NVR you can set Less, Default, or More puddles. I think it’s the same with NVE. But all the “RTX Graphics in GTAV” video creators usually use the More Puddles option
Fr
its not really a realism mod, cause they just really remastered the rendering engine to look like Germany instead of crazy vibrant colors.
It's crazy how the photo-realistic version actually has *less* details, but looks more real.
Its like it was recorded with a shitty camera lol
@@deus1784 No not at all the overall technology is amazing and putting this is strictly false, with a bit of tweaking the system can create sharpened high res image.
@@_vallee_5190 yeah but it still looks like it was recorded with a shitty camera
@@_vallee_5190 You misinterpreted that as a negative while Deus was in fact trying to use it as a positive, it truly looks like we're looking through a dashcam
Even the "vistas" version looks less realistic. Not 100% sure why and maybe it's just me, but it feels like because it has more color, the aliasing other artifacts art more noticeable and it doesn't look as real as the desaturated dashcam version.
This is the most realistic gameplay we'll ever see. Imagine future engines doing this in real time.
@Cristiano dos Santos Gomes That's because it's probably ✨gReEn✨
Check out "Unrecord"
It's very possible to do this in real time. It's just that it's ugly as hell and most companies would rather make pretty visually appealing games than ugly realistic games.
@@harrasikaCan't run on consoles yet so it ain't happening.
@@phelan8385 You don't need this specific image enhancement model to achieve these results. They had techniques in like 2015 that ran just fine and delivered an insanely realistic experience. As the person you replied to said, it won't happen because people will complain that it looks ugly. Life is ugly 99% of the time.
How is it photoreal if there isn’t 600 gallons of water on the ground
Underrated comment.
Lmfao
Thank you for this
For real all them mfs used was water
I remember seeing a mod showcase where the sun was as close as the moon.
finally a realistic graphics mod without making the floor wet
this isn't a mod
@@bloomingteratoma Its a mod its called ai training
@@xthinkfast No, it's literally not a mod. You can't install this to your game. Mods are used to modify the game in real time, this doesn't do that. 10 seconds to their page would have told you this, but hey I guess it's easier to be stupid than to be right.
@@bloomingteratoma Hey look, I managed to find 1 guy with a brain in the comments. You are correct, this is not a mod.
@@godthegod4491 bro go outside why you care so much ??
Hot take : adding more lights, colors, and reflection doesn't always make the game realistic
and everything being permanently wet.
That is not a hot take that is a fact.
The real hot take is that while it looks more realistic, it also looks uglier. Reality is ugly, I wanna look at the overly saturated base GTA 5 instead. lol
@@DemoniteBL Then your brain my friend is melted to the core of over saturation
Hot take: graphics don't matter one single bit IF the game isn't fun to begin with, no matter how good they are.
If you show this and tell me it is a dash cam footage, I wouldn't even recognize
@@row8261 that one guy who never gets the joke
@@quartermaster2809 and the one guy who deletes their comment after they realise they were wrong lol
@@rayanrashid7413 lmao
that one guy who can't relate to what these people are saying because context was removed
@@astral6749 haha
So this is what GTA IV's color grading was trying to achieve..
pretty much lol
I like how the quality loss helps to achieve the effect this is not GTA V but a car's camera
deus ex also tried similar approach iirc
hahah
lol
So this is why the matrix had a green tint
good point
Because it was filmed with a cheap dash cam?
watch until the end
@@lddroRre I feel you
All y’all saying the original looks more realistic actually needa go outside 😭
I would love to see how this program "enhances" the NPC characters walking around in the world.
What do their faces look like when looking at it close up after being trained.
I was thinking the same thing
There face wont change much it would look like u have just applied some filter.
There is a person walking right near the end of the video. Can’t really see the face though. I’d imagine the training dataset probably blurs out faces anyway?
@@mbcchoudhari885 I mean it's more than just a filter so if its taught well it could prob do it
@@blzrL hmn yeah maybe
I was expecting a bad mod showcase but I'm actually impressed by this.
REALISTIC GTA V **NOT CLICKBAIT**
Maybe its because its made by intel...
@@strongstonks7699 This is the most impressive thing they’ve released in a while then!
Maybe bcs the amount of work under this is probably a thousand times greater than of any game mod ever developed lol
How to download?
Amazing stuff, you could further improve this with actual LA footage and more relevant cars....
Oh you don’t want footage of LA... unless it’s from the air and at night or directly looking at the ocean.
@@CJAM03 Stfu… please just stfu
@@CJAM03 as a person thats lived in LA m whole life there is some places that look a bit run down or kinda of ghetto like grove street but with more apartments but it's mostly potholes in the streets and um... well potholes ^-^
@jpeg fern cool bro
@@JovanLemon almost as cool as you liking your own comment 😎
it looks like a dashcam that has a windscreen obscuring it
that is exactly how it was made if i understand correctly. All of the reference shots were taken from a dashcam in that mercedes they show.
@@user-fc5ou7pn2k well more of a camera than a dash cam but yeah basically
Bruh look at 7:40
Which arguably makes it photorealistic, as to get these shots you yourself would be behind the windscreen, probably with a dashcam
The funny part is, while driving in a straight line, my mind is totally convinced I'm watching a dashcam, but the second the car turns, the illusion is broken. I love video games :]
They used a model trained via photos taken from a dashcam with a windscreen obscuring it. If they used a different camera and took different reference photos (something that a videogame studio's art department could manage), it would produce results that look like whatever pictures they provided.
I think the really interesting part here is that they don't necessarily need to use a "better" camera or "better photos"... An art department could make artistic decisions when producing a reference photo data set; color settings, camera quality, the textures and colors and surface qualities of the objects in photos, etc would influence the end result.
The most impressive part about this is that they're playing GTA V while actually respecting traffic laws
this lol, was expecting him to hit a pedestrian in the end there
maybe scenes violating traffic laws are not in their dataset so may create artifacts?
Yea by driving between cars and driving on the wrong side when he was behind that bus lmao
😂
Now that's RP *GOATED*
Impressive..It's so realistic, it makes you obey traffic laws.
Lol
That might be more to do with the lack of actual interactivity in the methodology. Movement might be all it is capable of handling, hitting a sign or deforming a car is probably not possible without serious issues.
Yo lo hacía en gta vice city
Not if you're under 18 and don't drive!
@@josex6159 ?
If a AAA studio released a game with your realism filter, game streamers would call it dull.
Getting serious "Rockwell Retro Encabulator" vibes from this explainer video...
Was just going to post the Turbo Encabulator lol!!!!
Is this... the panametric fam ?
Bro, I just said the same thing in my head. lol
Rockstar Retro Encabulator
They forgot to mention the non-reciprocating dingle-arm
Game developers: "let's make this game look detailed and colorful to be realistic"
Some German Guy: "realism is Russian dashcam video"
The model is trained on dashcam video frames so it will look like a dashcam video. Could look much better if gopro footages were used which I am sure is not available on this scale.
But its german dashcam video
thats the actual definition of realism, whereas other variations of realism is actually just 4k
It does look photo real tho
I see you didn't actually watch the video.
The only thing holding this back is that you feel slightly more guilty when you kill a random pedestrian
Nah m8, crowbar fps go brrr
Yep. that's what i'm talking about 😂😂
Lets get ptsd
I don't feel guilty.
Wdym with "slightly *more* ", do you feel guilty for killing a npc or what? XD
This video is 2 years old. Has it ever been released as a useable model? Is there a way to access & use it?
nah they just baiting for views all fake
this is where games are going. not just AI behaviour and intelligence to allow them to understand and act based on your natural speech (like the games that the main character plays in the movie 'Her') but also stuff like this that makes the game look damn near real. this might even be a reshade mod in 5-10 yrs..
who are you
I'm no engineer but seeing how many processes are necessary in order to achieve the end result I think the computing power of consumer end PCs won't be able to give such an output for a little bit longer. It's doable on really beefy machines, but I doubt it's done in real time otherwise the framerate would be absolutely horrendous to look at for extended periods of time.
Whatsup asmongold
what is this "AI behaviour and intelligence" you speak of? games are as stupid as they were 20 years ago
Half Life bhopping in real life incoming!
This video being 720p takes away from the illusion
I think the problem is with the method itself, maybe it can't handle 1080p+ images yet, or maybe it takes too much processing to do, as the game was running in 20fps.
I heard 4K is only just a trip outside away
Your rather look at sub 720P videos at a 1080P? ITll still look like shit
It's an early tech. I'm sure they will be able to render in 1080 and more in the near future. But to expect something that looks this good to not have limitations is crazy. There are always limits on tech until they are refined. We all just gotta calm down and be patient lol
That's the trick with just about every "photo-realistic" claim. Blurring everything. Your brain fills in the gaps to support the illusion and you can't point at anything in particular that doesn't look realistic because it's all blurry.
And if you try to point this out, they have the copout excuse of "Oh, we said PHOTO realistic. As you can see, this is blurry just like a russian dashcam". Like, dude...
nodding along like I know anything they're talking about LOL
It's very straight-forward stuff. They tell computer "try creating random filters until it turns pic 1 into pic 2" and eventually it works. That's all neural nets are, essentially trial and error.
@@themodfather9382 lol its because they use so many big words and abbreviations. at some points I just found myself dozing off and hearing TV static 😂😂
@@ROADHouse702 kljklklj
@@themodfather9382 its not straight forward if more than 99% of the people in the world dont know this shit.
Same well i guess it time to get deep in this field in order to gain more knowledge and opportunities .
The comparation with the Los Angeles dataset really puts in perspective of how well Rockstar captured the Los Angeles atmosphere in GTA V
Just think about it. THREE People did this. You should show this Rockstar Games
new gta 6 be like
@@furkanyldz8460 nah but the ps5 gta might
Moin Deniz 😂
Rockstar wouldn't implement this. Why? Because it would cost money to implement, and won't earn them any in return
nintendo hire this man!!!#!2!2!2!3?_?'
I want a one hour drive through the whole map with this realistic POV only.
but with better fps
@@Kayshots and played with a controller at least
@@SerpentSeven777 my thoughts exactly lmao
its better and cheaper to go to LA and drive around in a rented mercedes benz, than buying a PC than can run this photo tingamagic
@@tpenoel88 what if i want los santos?
Wow, that looks legitimately real. Like it was filmed in the 2010s.
In few papers down the line, results will be more amazing.
7:47 bumps things up a notch
@@luckys541 wink wonk
@Slam Nuts On Table Ok nut slammer 😈
GAY RIGHTS 🏳️🌈
I'm sorry but Los Angeles, Los Santos anyway that city doesn't appear really sad depression carrier but per contra it's really cheerful and warm.
they have to do this trained on realistic dashcams (or just cameras in genera). But it CAN'T be phone cameras, it has to be cameras that capture color and light correct.
now this is it! not just some wet road fetish lol
This is GTA 4
@@houghwhite411 Lol no
@@underhillat lmao gta iv's color grading is much more realistic
@@houghwhite411 Not even close wtf
@@houghwhite411 u high on drugs
This is actually photorealistic, unlike every other graphical enhancement mod for GTA that just increases reflection and make every road wet
Finally someone who gets it
Wet is best 💦👍
and also makes everything colorful like a cartoon show.
@@ogblue8159 What, your world doesn't look like a constant LSD trip?
@richardhalo yea thats not real but look at the trees its just like real life ,
Its like an old recording from the 90s or early 2000s. Very impressive.
like in those earlt 90s rap music videos.
shhh, they've only just discovered sub HD
The filter is not bad but imagine playing GTA5 like this
Cool but you made Gta V look like Gta IV
This wasn't actually a mod, it was kinda like stable diffusion.
@@throwaway5096What
@@The_Alpha_E It's a re-render based on the images, not the actual game. Also yes it does look like shit lmao.
@@slamkam07 Yeah but no one said it was a mod though
The real world looks more gray and has less sunshine, got it.
And the moon isn’t right behind the clouds.
7:47
Not at All. There is SunShine All over the World. But Most American Cities it Always looked Gray for some Reason in Real.
As stated in the video, the first set was intended to imitate dashcams, washed-out colors included.
@@SamRichardson1990 weird because LA is very bright and sunny.
I was hoping they'd show us a car crashing into a building at 60 mph.
i think we need to crash a bunch of cars into buildings to train the system :D
"oops that was a real video"
I wanna see a group of people get their shit rocked by a m134
search Beam NG Drive for realistic damage simulation
@@AnthonyVD1310 unrealistic graphics tho
This is what ENB/graphic mods creators should be doing instead of oversaturating the colors, overusing ssao and flooding the floor and making it look like a damn mirror, and also try to sell that shit for 10 bucks a month
bruh they do that to show the RTX effects bruh use some brain baka
@@ThirstyEdits there's no rtx in GTA v because the game cannot handle rtx bruh use some brain baka
@@ThirstyEdits maybe screen space reflections (SSR) but not rtx, they just make the game look like shit with all of that water and they don't show anything new
Some of them don't overdo it: th-cam.com/video/-S24gQntcWg/w-d-xo.html
@@lalala-t6d Yes I know, but a lot of them just make the road look like a mirror and that's annoying
So, you've basically made GTA V look like GTA IV?
Take ALL my money.
Literally when I saw it I thought “Looks like GTA IV with better graphics”
It’s because GTA IV was basically perfect
@@OFFtheCHIZANE Only the actual main game tho. Ballad of gay tony and los mc sucked
@@swen6390 stfu theyre GREAT
@@swen6390 those where the best of dlcs for rockstar wtf is wrong with you
Imagine if:
- GTA V was made in 2021, raising the graphics standard of the base game
- The AI dataset was made with a 4K camera instead of a LQ dashcam
- The AI dataset was recorded in Los Angeles instead of Germany, matching GTA V's setting
The result would be insane.
Imagine they travel in time toward future to film 8K dataset and they use it on Cyberpunk ahah
One can dream... Maybe in a decade who knows, but games are getting more and more ""ultrarealistic"" or cartoonish
Just wait for a ten years. We will see them all.
so basically gta v if rockstar wasn't lazy
Imagine if a video dedicated to showing graphics off wasn't uploaded at 720p in 2021. FFS ppl
Finally, using cutting edge AI technology, we can turn GTA 5 into GTA 4.
lmfao
ikr it looks worse
@@arekkusu0o it looks worse and similar to GTA4, because as they said, they used images from irl germany and they were washed out grey. If they had used images from California, it would be more colorful. And they did show a better colored version at the end of video around 7:00 I think.
Finally, someone that understands and can see the huge difference. Sarcasm of course in case you didn’t notice as you didn’t in the video.
Also have to remeber these aren't 4k cameras these are basic dashcams and photos from germany. Strap on 4k cams and go to LA and its a whole different story
720p...
:(
in 720p the game was already running at 20 fps, imagine 4k LMFAO.
69th like
Running intel gpus 😂
Did you notice the jerky controller input? Why didn't they use a wheel, or stiffer thumb, or mouse, or pong paddle? They ruined the real side for me, like the driver had a wasp in the cab!
720p and compressed af :(
Rockstar: GTA V
Intel: GTA IV
what are you trying to tell? that Intel's is worse? because IV is 4, VI is 6
Intel knows nothing about graphics 😂
@JET0802 yeah is there no data set for fuckin LA? you'd think that'd be one of the first places that'd have that type of thing lmao
@@netio112 im just asking because people sometimes mix IV and VI
@JET0802 I didn't get them either. Los Angeles is sunny and colorful enough to really look like that. But they come um with a German grayish landscape. Wtf??
This looks better than their “enhanced and expanded” version
where can i download this mod ?
Everything looks better than E&E
@@albinjt its not a mod
Shame to rockstar
any gta 5 gameplay is better then e&e ver
We should compare this to GTA6 in 2025
Ok, but imagine training this AI on a dataset of GTA V screenshots and applying it to real life footage...
WOAH
I like how you think
If they make a simple enough software it can become a Instagram/tiktok trend lmao. Input your images and the engine will render them to look as if you were inside the game.
Or we could go outside and eat an apple
@@shem269 ehhh, kinda boring.
This is why GTA 4 still looks real sometimes despite having lower fidelity graphics, the colours are more true to life. Anyway, I achieved this by just upping the green tint on the TV, and it made GTA 5 look way more lifelike and real. It doesn’t make it go green it just makes the colours look more natural like this video.
Exactly if you go back and even watch the gta 4 trailers the whole color system gave that game such an realistic feeling. I live in Germany and here in winter it very feels „grey“ and in summer „green“ just exactly like in this video. The matrix unreal engine demo felt also so realistic I think because of its „green“ colors
The colors in this video look extremely unnaturally green to me like they added a Matrix color filter on it. There is also too much greenery in general when LA does not have nearly that much vegetation that is so green. IMO although the original looks a lot more true to real life simply because it used LA for reference unlike the AI which only has data from Germany. To me the new images do not look realistic at all.
Go outside during spring or summer. Look at some grass and flowers. You might start to realize that the real world can actually be beautiful, and that “gray and gritty” doesn’t equal “realism”.
@@kalecccxi333 And that the place where GTA IV is set isn't colorful and pretty at all. You buffoon.
@@kalecccxi333 all of you are expertly wrong. The closest source to life like realism is Kodachromes. It has the sun exposure, the dark mix of colors, and the correct saturation unlike modern cameras that lack both frequencies.
I wonder if the results would be more accurate if you used images of Los Angeles in the dataset, to more closely match the setting of GTAV? This is fascinating stuff.
If only there was a dashcam data bank in LA
Can confirm the lighting is a bit more white/yellow, not green, here.
We tend to not have a lot of overcast days, most of the time the skies are clear, and we're right off the ocean, too.
It's not a huge deal but while neither quite match the true lighting in LA, GTAs is a bit closer while the mod's realism is a lot better.
@@KingNefiiria it’s not a mod tho
@@luc9450 shut up you know what I mean
@@KingNefiiria didn’t mean to come off as rude, sorry mate. Was just trying to inform
“So how much ram do you need to run this?”
“Yeah”
2 fps.
I remember when Anti-Aliasing options first appeared as 2x, it could cut frame rate by 2. So in theory if we would accept 30 frames per-second again for a while, re-renderering a frame based on AI analysis might not be THAT mad of a technique.
i dont think there will be that much of a difference cause its rendering real time photos not a model so that will help but ofc 8gb of ram wouldnt be enough i guess 12 gb of ram should be good for it tho the game is highly doubted to run no more than 30 fps so yeah thats it if you ask me i guess the minimum requirement would be, 12gb ram GTX 1050ti tho its just an assumption
@@selamentor Yep. Plus while sandbox type game is really heavy on "continuity" comparison, imagine something slower, like adventure horror or even virtual found-footage game experience.
@@magnuskallas resident evil 8 has potential tho the orignal graphics are pretty much amazing but a photos realism will change everything
My third grade teacher: “quit putting ‘the end’ the end of your paper. It makes you sound dumb”
These guys, obviously smarter than my entire hometown combined:
Exactly my thought 😂😂
"Produces less artifacts" is grammatically incorrect. Just because you are a ML researcher does not mean you know how to "write good".
French filmmakers have entered the chat
@@StereoTyp0 first how is that grammatically incorrect, just asking out of curiosity, since this is irrelevant to the point being made, because put "the end" is more a choice than anything else.
@@whyitmatters6906 "produces fewer artifacts", would be correct line.
"Less" is used not supposed to be used with discrete nouns being counted. For example, if I said, "there were less people at the store", it grammatically implies that I'm referring to some measured amount, such as the mass of the people missing. It basically implies a strange observation such as, "there were 123.4 kgs less people at store". This reads as strange because it divides discrete units such as individual people. Conversely, using "fewer" with mass singular nouns is equally incorrect, e.g. "I used fewer salt to season the soup".
Either way, this grammatical rule and the use of "the end" are both examples of a writing style that I would find unacceptable from a professional writer but be less offended to find in a presentation written by a professional engineer.
Edit: accidentally a word.
Man they need to run a realistic physics mod because the jerky car physics are just about the only thing that makes it immediately obvious this is a game.
i think things would go a step further if the driver was using a controller, allowing for finer control of acceleration and turning
@@joshua7563 yeah but the problem with that is you can't do much else with a steering wheel once you hop out of the car
@@slin0053 Could have steering wheel and mouse/keyboard or controller both ready to go right next to it
@@Darkhunter218 how many people do you know have the inclination or space to set up a a steering wheel with/beside their mouse and keyboard though
@@slin0053 people who have a steering wheel
Imagine if they had used HD images of Los Angeles to do this.
Los Angelos smells
Too bad it's impossible to get HD images of Los Angeles...
/s
@@Chad123-g3d ehhh not really
@@quangos9455 ehhh yes really
@@umamifan ehhh yes really
So that's what I've been clicking those captchas for all this time?
You know what, I think you might be on to something here...
Effectively yeah. It's a weird concept to prove you're human by teaching the robot what humans see.
But automatic cars would be quite difficult to implement without it knowing that the leaf that crossed it's sensor is not something worthy of an aggressive lane change to avoid an accident.
literally yes
yes, actually.
No I guess cause when you choose the wrong images then you are not allowed to proceed,that means the AI already has the info of what the correct images are.
Makes video about Photorealism
Uploads it in 720p
Looks great, but could really use some extra pixels xD
And the more frames... I mean, we are seeing less data because of the low framrate lock.
I suspect that the dataset German city streets is 720p at most (they said "automotive quality", which is a nice way of saying not very high quality at all). For higher resolutions, you would need higher res reference data.
@@no1DdC More likely it's 720p for game performance while the enhancement is running and recording at the same time.
@@VincentNacon I highly doubt the enhancement is running on the same machine. It's also likely not running in what gamers would consider real-time. "Interactive frame rates" is a nice way of saying "far less than 30fps", just like "automotive grade quality" means low-res.
this thing is still in its infancy, give it a year or two and watch how crazy it can get
The sickest thing about this is, that in 10 years we will look back and think "lol, the graphic wasnt that good actually"
@@lucasfoster8900 how? It looks so realistic.
Its not that good now.
Well this method is not even used by a game yet , it will take more like 20 years for this to be viable assuming computers will keep getting better.
I think games will keep their game in the cartoonish realm so people can't abuse the system. And get a ton media hate on how video games kill people lol.
Pretty sure we will be living in a virtual world by 2040 :P.
@@joeroganpodfantasy42 definitely not 20 years lmao , technology grows exponentially not linearly
This is what GTA 5 will look like after rockstar rereleases it for the 88th time in 2167
It doesn't look real though, they use footage from low quality DASHCAMS. That isnt how peoples eyes work, the vanilla game looks more realistic.
This is the perfect example of the difference between realistic and Beautiful.
7:47
I disagree, gray is REALLY beautiful. It's one of the things I miss in my small city coming from e medium city.
@@TheEmolano no gray is sucks especially if it's a car color
GTA V is neither
@@Nothing-xw4tf It's okay. You'll understand the beauty of humble colors when you're older.
TH-cam really did you nasty with lossy compression. the images on the site are strikingly photorealistic, to the point that looking back at GTAV you can immediately tell what looks off. That game that used to represent a standard for photoreal graphics in AAA defeated so mercilessly is jaw droppingly awesome.
Though one minor complaint I would put forward us the cityscapes color washing out GTA's vibrant LA theme. perhaps some LA _esque_ colorgrading on the training material or your result would give a more appreciable image.
Mappilary doesn't suffer from that discoloration but I feel its result isn't as convincing
Well it is a photorealistic enhancement. By re-rendering each frame, it naturally loses some of the vibrant colors that were deliberately decided on when coloring the scenes of the game.
@@cane870 so would you prefer to watch movies without color grading ? plus you've completely missed my point. the discoloration doesn't come from a place of photorealism but from the limitations of dash cam grade footage. I'm saying that fixing it would make it look better, not more photorealistic.
I don't find it that impressive tbh. I think rockstar could make it look like that if they wanted if they tweaked the textures (the most obvious would be to make the road texture have less contrast), car reflections (they could use raytracing nowadays) and tinkered with the color grading. However, GTA was never aiming to be 100% photorealistic. While it's very detailed and quite realistic, it always had an art style. Also, remember it's a 2013 PS3/X360 game. Like, it's good but not THAT groundbreaking. If they used it on GTA3 level graphics and get these results that would be way more impressive. But it doesn't seem to add in much geometric detail apart from the vegetation.
+
well really it's not defeated, because gta v oem graphics look better, but that was the point the colors are more vibrant, and everything is meant to be ultra realistic when in reality, everything is a bit more depressing. This program did a great job at somehow making things look more like a HD police dash cam than graphics in a video game.
i find it hilarious that the photoreaism thing makes it look more like gta 4.
ive been saying it since gta 4 came out, that game just had such a realistic vibe to it. it was on another level.
Ok
Exactly. If you removed that weird resolution thing, made it clearer, it would look A LOT better.
When a game makes you feel hot and cold based on colours, that’s a real looking game.
It was embedded in the physics engine as well. Drive a car into a wall and GTA4 and then do it in 5. The contrast is stark. GTAV with GTA4 physics wouldve been the shit but people whined about it being too realistic
@@isaacsrandomvideos667 like u said, EXACTLY!!
gta 4 has extraordinary graphics, its just the resolution that was aged. the graphics themselves and even more so the colours, were just special. that world felt real when i first played it. i was in absolute awe!!
This would look realistic if our eyes saw the entire world around us with the quality and resolution of a dash cam on a car, because that's the source footage the neural network used as the reference. The real world doesn't look like that at all. So no, this is not "realistic", this is just playing GTA 5 with a dash cam filter or shader on top of everything, replacing the textures and lighting FX. Interesting and promising, anyway.
Dang
true
"Sometimes reality is often disapointing"
-thanos
👏👏👏👏
Sometimes. Often. Pick one.
The joke
@@osakanone
Me: watches video
My PC: You forget a thousand things everyday, how 'bout you make sure this is one of em
underrated lol
lolol
My pants are full of poop :)
@@بِلَادٱلرَّافِدَيْنبِلَادٱلرَّ my pants are full of big balls and a magic stick
I've been thinking about this a lot lately: at this point in technology, I think the least realistic aspect of video game graphics is just the oversaturation and sharpness of everything.
Add to that better physics engines, capacity for higher asset density, and more realistic AI. The physics engines in games still make everything feel too clunky or weightless, most open world games have large maps but are often mostly comprised of shell assets which are static and can't be explored or interacted with, and interactions with most NPCs still remain immersion breaking imo.
@@sword_of_damocle5 i believe that's what cyberpunk was aiming for just missed entirely
I mean speak for yourself. In my experience, the real world is FILLED with color
It makes it more pleasing to look at. The real world itself is beautiful in its own right but more boring to look at than say an 8k rain enhancer script in gta 5
@@litmus7325 Yeah. They're basing their enhancement algorithm off of dashcam footage, which explains the washed out colors.
This isn't realistic it just looks like it was filmed with a dash cam
Mofo how do you want it to look? Dashcam footage is realistic, it is LITERALLY real. If it looks like real cam footage it is realistic, just go outside bro.
@@averageyoutubehandle497 If you go outside and it looks like a dashcam you need to get your eyes checked.
@@lemonwithalime I mean that's how it looks when you're In a car, especially in Germany. But yeah no this isn't fitting for GTA
This is a huge shortcut to getting realism with CGI, those of us who work at archviz will be very grateful when it becomes available ...
Yes and no. We already deal with a bunch of people who don't even know how to model anything bespoke, going into archviz because the stock models and rendering engines are cheap and good. The low bar of entry lowers the overall value of the work, as more people flood the market offering their services (though this is visually offset by the fact that stock models and rendering engines are so good now). I observed the same issue in the field of photography - cameras got cheaper, better, smaller + the internet started offering endless tutorials and free stock (unsplash, pexels, etc) = hard to find well-paying work for everyone, because Joe Schmo can show up at the door and do it for next-to-nothing + more and more agents shift to just doing it on their phone. A lot of stuff that used to be photographic jobs - moved to 3D, where it's easier and faster. A lot of 3D also moved overseas, where a guy from India can do 3-5 jobs for the price of 1 in the west. Etc etc etc.
Basically what I'm saying is - it's your own demise. Fun at the start, "yay tech!" and all that, but ultimately you'll need to change professions to put bread on the table because at some point this tech will make it impossible to make money anymore. Short-term thinking vs long-term reality.
@@TheUltimateBlooper A low barrier to entry is great. If your work is reliant on there being a higher barrier of entry, then maybe your work is shit in the first place? After all you're basically admitting it's just a synthetic barrier that is helping you. We're going to end up making the art accessible by tons more people with much less work requires, and that's only a good thing.
@@TheUltimateBlooper this is ludicrous logic. By that logic, there should be zero professional photographers. Tutorials and demonstrations mean absolutely nothing if you are incapable of doing it as a client, It's the same reason why TH-cam has videos showing how designers make their products. Sure, someone could go out and buy all the materials and tooling needed and recreate it, but the artisan relies on the fact that people's time is more valuable than simply paying the right person for the job
@@TheUltimateBlooper a bit agree with you. Archviz videos used to be super expensive and now plummeted because Lumion. But, just like another job, we need to step up our efforts harder than ever using these new technology. And don't put all of your eggs in one archviz basket, you can do TH-cam, artistry, or whatever
I want to know how ps5 version will look
Legitimately thought that y’all switched to real life footage for a second
Some people are memeing in the comments, but genuinely, my jaw's a bit agape. For most of the footage altered by the software, it genuinely looks like a google street view camera, moving in front of me... although with higher camera quality, and it feels much more realistic to human sight, rather than simply a camera's footage. It's genuinely astounding to me just how amazingly real it looks! I never thought photorealism could look realistic, there'd always be that uncanny valley to it, but... this video changed my mind on that, that's for damn sure.
Absolutely incredible!
The game looks like a smoother GTA4. Rockstar could've done this but didnt because its bland. Games have style. Gta5s style is west coast 90s. Supposed to be like a Tupac video. And I wouldnt even say it looks realistic. Real life is alot more colorful than this especially in the US, especially in a city like LA. Looks like a dashcam from 2003. It's somewhat impressive sure but then again rockstar could do this if they wanted
@@jaystuder4458
Rockstar right now could make a GTA 6 that looks similar, but in 2013 they could not come close to this.
Not to mention this tech does not actually render any 3d graphics, it just uses AI the generate the frames. Completely different.
@@JonDoe-uq1mk people made mods that looked almost this good when the game first came out rockstar is a billion dollar company with millions of workers and they could definitely do this they chose not to because it just doesnt look appealing
@@jaystuder4458 weren't the mods just making gta look like the fire department went postal and just sprayed all the roads with water?
The more I look at it, somehow it kinda reminds me of GTA IV.
Yeah because the lighting is looks similar of gta 4
To summarise what they were saying. "We trained and AI to enhance the game based off a set of images from IRL. Also our competitors are trash."
this summarise pretty much 70% of computer graphics papers these days lmao
The competitors aren't trash per se, they're just processing the images.
These guys are pulling object data from the game engine to tune the process.
I'd imagine a game dev could work an engine like this into their game. Heck, rather than use libraries of dashcam footage, Rockstar could literally pull some 4K or 8K camera footage from Los Angeles themselves. Also, imagine having an on-the-fly FaceApp-style filter applied to the characters to give them real face replacements.
@@GiuseppeGaetanoSabatelli it's awesome technology! As a proof of concept I think it has a heap of potential and I'm keen to see something like this implemented to games via GPU similar to DLSS and ray tracing.
don't worry my comment on the competitors was purely satirical. I just think most of these companies need to be able to explain and demonstrate in layman's terms. It just overwhelms and alienates a solid portion of the audience.
@@GiuseppeGaetanoSabatelli Personally, I didn't interpreted the competitors as being "literally" more thrash. This video is simply a demo to support their research publication, and the goal for research publication is to convince that your proposed solution is novel and effectively solve complex and relevant problems compared to other methods that already exists. So of course you will try to demonstrate that you were able to improve from other previous related work. And I think what amused me the most from reading this comment is the fact that there is a dramatic increase in the amount of papers using Deep Learning instead of manually finding better algorithms to solve quite complex problems, and they can be more or less summarised like this: "We chose an architecture like this, found these hyperparams, and now we can basically do this thing 10x times faster and better than the algorithm you guys been working on for the past 5 years" which can be quite baffling. (I am not trying to say this is wrong though, there's a limit in what we can achieve with conventional programming and ML is there of that and it's there to stay)
On a side note, I don't think we are nowhere near to be using this type of technology in games. When a paper claims the algorithms work at interactive rates (so not real-time rates), it means maybe 10fps minimum. In the conclusion of their paper, they mention that their system in its unoptimized forms takes half a second for rendering on a RTX 3090 GPU, which could be improved with appropriate use of G-Buffer. I also think most people mistakenly believe that this is some kind of company putting forward a "proof of concept" to be implemented in games. They are not, the three are all research scientists working for different firms (two of them are from Intelligent Systems at Intel)
It's so realistic, it fixes broken American roads with efficient, clean and well maintained German roads.
Edit - For complete morons out there who need to psychoanalyse this post. It is a jab at German efficiency and the generalisation thereof from the early 1900s. For those of you too dense to understand, Clearly not every US road is bad and not every German road is good. If you watched the video you will get that the roads were smoothed out by the German town footage and the streets in the game GTA 5 were shoddy. Hence the joke that German efficiency fixed the roads. Nothing more, nothing less. 800 people understood the joke, but you had to go and be special didn't you?
if you knew how some roads in germany look like lmao
@@Antoni1018 Not saying all, but from the ones I saw, they were much nicer than L.A Streets I can tell you.
@@ninjapants7688 ye i feel you
@@ninjapants7688 Can confirm, lived in LA for most of my life.
@@ninjapants7688 areas that have bad governments have bad roads, it's a fact. Just look at Michigan lmao.
Now imagine if this technique could be applied to City Skylines graphics what could be created...
stop it i am running out of tissues
I don't have enough ram in my computer
@@candle86 bruh i have 16gb ram and could only play upto 120k~ population before it started lagging
@@candle86 I hear you can just download more ram... 😁
This
Title of the paper: How to turn a GTA game into a Matrix game: a deep learning based approach.