Can Nvidia's VSR Enhance Low quality videos?
ฝัง
- เผยแพร่เมื่อ 28 เม.ย. 2024
- In the FIRST part of hopefully dozens of videos covering upscaling, I investigate whether VSR can improve the look of rubbish videos and low bitrate settings.
0:00 - Intro
1:07 - Cartoons and anime
2:32 - My lowest quality video
6:11 - Antialiasing helps
6:39 - Conclusion - วิทยาศาสตร์และเทคโนโลยี
I hope your next upscaling video is an hour long and the most complicated yet. I enjoy them so much thanks for doing what you do!
Same
Why stop there? 4 HOURS LET'S GOOOOOOOOOOOOOOO !!!!!
Same!!
I've upscaled a couple hundred hours of animation using ESRGAN and found nowhere to put it. Quality is excellent.
I'd love to see a 3 hour video from him on the subject, I'd easily set a day aside for it.
I recently got a 3060 so it's nice to finally be able to actually use the things that you talk about
I recently got a rtx 2070 too bad I can't use it until I Wait patiently for a update
@@eee1200 it wont come
@@eldafint nvidia literally said it will lol
3060 can only upscale on lvl1
@@coin777 i can access all 4 levels on ny pc
I'd love to see 2kliksphilip cover Lossless Scaling. I've been enjoying scaling everything using the LS1 upscaler. Supposedly it's based on machine-learning but it mostly manifests as a more accurate looking representation of the original native image-as if it does such an effective job scaling, the need for native resolution almost becomes nonexistent.
Okay I had no idea Lossless Scaling had progressed so much since I last touched it. The last time I tried it, it only had FSR, NIS and integer scaling, but now it has tons of other modes. Magpie is a good alternative too, used to be much better than Lossless Scaling because it had many other shaders to choose from while Lossless Scaling only had FSR, integer and NIS, but now Lossless Scaling has pretty much caught up in terms of features, and it's interesting that they made their own upscaling algorithm that seems to perform as well as FSR and have a better quality.
I hear about people complaining about the input lag is it good or bad?
Where do you use it ? I have tried it once in game and it destroyed my performance so I haven't tried ever since.
@@A.Froster You can use it on TH-cam if you're a little creative and find a way to open the video on a separate window that you can upscale. I use the Enhancer for TH-cam extension and set up both the pop-up player size and resolution to the size I want to upscale from.
Ok
Honestly, if you showed me the two videos separately I would not be able to tell which one is enhanced with 100% certainty.
i dont know how to tell if its actually on
Same. Watching at 4K with premium on a 3440p OLED HDR1000 Display. There is almost no difference at all, or the small difference gets lost thanks to compression.
I've seen bigger improvements by just upping contrast or using simple reshade presets
you could actually see it cleary if you use it yourself
I can't wait to use VSR to enhance 2kiliksphilps beard
This is honestly more impressive to me than many other upscalers that I've seen bc of it striking that balance as you mentioned. I honestly think that's the optimal way those pixelated stairs should be handled when there's a similarly colored flat wall right next to them, so I'm actually glad it didn't try to "make more stairs" and end up getting it wrong
actually there was no stairs at all in some of blocks, so yes.
I feel like your stairs example at 5:53 was actually the most impressive one. It almost does seem like it's adding stairs where they should be!
Even just for fixing blurry or unreadable text this looks pretty amazing
Keep making the videos you want and make them as long as you want, your love for the craft shows through to your videos.
I love to hear someone talk about something they love
Can we get a video about video compression? I want to hear you talk about video codecs, hardware vs software encoding, etc. Doing something like reducing a video file size by 80% while only reducing its quality by 20% is possible with today's video compression and the AV1 codec (free and open source), theres lots of poorly compressed videos sitting on peoples hard drive that could benefit from this.
THISSSS
AV1 Preset 6 to 8 for max compression with CRF set. At least in my testing.
Compressing my Videos on kliksphilip
didnt he do something like that already when talking about his archiving process?
Poorly compressed videos benefit the most from not being touched again. Though I agree that some informative video on this would be great, I see plenty of people completely clueless about digital video, sometimes even in areas that you would expect them to know at least something useful. For example most Handbrake users have no idea what they are doing and it pains me.
Some of the background music made this feel like a "Look Around You" video, and I love you for this Philip.
Your upscaling videos are my favorite so I wouldn't mind a longer one.
I would love a comparison to real time upscaling decoders like madVR using the best al'gos like jinc and all the other bells and whistles that have been available for years
i hope to see longer videos from 2kliksphilip about upscaling
this video is really cool and this tech needs more of a spotlight as, like you said, it propels the tech from "enthusiast-only" to the general masses. I'm really looking forward to part 2 (and 3 and 4 hopefully!)
This channel went from CS:GO to tech tutorials and analysis overnight
I found it applied some kind of smoothing that deleted detail from lower resolution textures (source engine road textures on a 1080p video became solid grey) and in another example to human skin (A 1080p Q&A style video where it heavily smoothed the skin of the subjects, approaching what happens when you go too far with Topaz). Maybe because I was trying the level 4 setting.
Please make a follow up on this where you do the things you said would make a too long video. I fee like the four different presets make no difference. They even draw the same amount of power
I appreciate that you don't wanna do a long video about VSR on real life footage, but I do want to see it.
This works great for this case, but I'm really curious how it would look on something like a low bitrate video of an NES or SNES game. Would it be able to recognize it's a pixelated source and do its best to preserve that, or mistake parts of the pixelation with artifacts as just artifacts that need to be smoothed?
Hearing morrowind music made me so nostalgic. I had a drink or two and I'm really missing my childhood. Thank you Philip for this video. I don't think I'll remember anything from this video, but right now you made me feel really comfortable and happy with myself.
this is really nice and i think it does the right thing
since its a general driver setting you dont wanna have to toggle it a lot
so its conservative, but that means it never looks worse, so you have no reason to ever disable it
but a thought: i was watching this with the feature on
what happens if you keep running a video through it over and over?
Dear Phillip,
I just want you to know that I have zero interest in upscaling. But I greatly enjoy watching videos about topics that you are pasionate about. So please continue!
I love your videos no matter how long or complex they become 😂
Just used this to watch some of the first season of bleach and it looks fantastic! And it was nice to have some scene with a lot of on screen effects that shows what the original image looked like.
i have been testing since it came out, and it works ok so far, your are on point :)
I'm excited to see how it makes blocky low bitrate twitch/youtube streams look
That's pretty sweet. It's subtle but definitely sharpens up the image and removes banding. Shame it's only available on RTX cards AT THE MOMENT (waiting for nvidia to do their usual and enable it for older cards once AMD does it better). Please do a test on GoPro footage. Being able to record at 1080p and upscale to 4k would save a ton of battery life and file size. I don't know if it has the option to smooth the frame rate as well but that would be another way to save even more battery life.
3:30 I noticed the same color change thing in the past using de-jpeg filters, where even on a completely greyscale image, it will add a slight amount of color.
Im interested if they can translate the DLSS 3 "frame generation" into VSR. 30fps youtube videos at 60fps would be brilliant
i would be more happy if they translated twich streams from 60 to 120
The king of upscaling
Thank you klik, very cool
Wonderful Video so far!
Watching this in 480p, very interesting indeed.
Hi Philip,
what easy to use Video Upscaling Program would you recommend for an RTX 2080Ti + 9900k?
I want to Upscale Videos from an older Actioncam, the Video is a simple top-down tech tutorial and I want to sharpen the Image before I upload it.
Can you recommend anything or would you be down about doing a "how to upscale" `Video?
Already tried Video2x, but the first pass with the RealSR driver takes 20+ hours already and is only 30% done - I set the Scale Ratio to 4,00.
The final, edited Video is about 2GB big, 17min long and 1080p.
RAW clips from the ActionCam are about 7hours, 60GB.
I do not even need it to be 4k, just want a sharper Image.
It's hard to use buy Selur's Hybrid is great for upscaling videos without it taking forever like if you use AI upscaling. And if you don't want to upscale and just want a sharper image, you could try with a sharpening filter like CAS.
Topaz is pretty good. I hope you aren't trying to upscale the whole 7 hours?
The use of Skyrim's theme was a Chef's kiss.
Watching this video with VSR on may make this more complicated!
I checked out VSR on some videos and I definitely noticed the same sorta "dithering" artifacts and in one case it made the video look awful (The video was Katie Melua's music video "Love is a Silent Thief").
If we're throwing "filters" on videos now, I'd love to see some color debanding too
Ill be honest, for me this is a thing of: If I look for it I find the improvements.
If I just watch normally its all the same to me.
I might have overheard it, but a significant issue with this approach, for all its here highlighted upsides is the massive wattage required for this to take place. I read about the big cards spooling up to full power draw.
Such a cool feature!!
Have you created new music? I haven't rally paid attention to it before since music is usually just a part of the Kliksphilip experience for me but for some reason watching this video around 2/3 through I felt like the songs were remixes of older music instead. I liked it though :)
I have a 20 series card and "Deinterlacing" is available in the nvidia control panel in the same section where VSR shows up for everyone else. Is that new? I don't remember seeing that before.
liking the new music
This is incredibly cool.
That bgm makes me feel emotional about an upscaler
great work!!
Good thing this video was short, that gives you more time to work on your Half Life RTX video!
So one of the parts I am missing from this video and your description of a future one - what is the impact on my GPU/performance using this? I have youtube running on a 2nd screen when playing games, but if it's going to snoop frames away from those games (more than running the video in the first case) I might not enable it.
I'm from the future and with my old 6090 TI with 512 GB video memory, VSR 3.11 for Neural Networks really is a game changer.
You are right about technology not being *magic* but when I show someone from 1984 what we had in 2028, they are impressed, but wonder how our synth pop music became so terrible.
You're right that using data from before and after a scene done right would be the holy grail. But methinks it takes too much processing power right now and that's why it hasn't been implemented. Not the fact that it's too hard to code or something.
i've used vsr for a week (turned it on and forgot about it) until recently because i began to dislike the quality from the upscaled videos and the amount of noise i was getting from my PC for just watching a simple youtube video
i only recommend it if it really helps any of y'all out with bad quality videos in any way and if you don't have an issue with sounds from your PC
I wonder why does VSR turns cyan colored “Off” text into green “On” and moves it to the right🤔
I was wondering why I couldn't see the effects in the on/off comparisons... just to remember I still had VSR on in my own browser ffs
This is very cool!
I hope you didn't decide not doing the 'most complicated video yet about upscaling' because of us. I bet most will enjoy even if you come up with a new one-hour-long video
I'd certainly like it
In my experience, any video that goes through the NVEnc on the gpu tends to come out with more red saturation than before. It's very subtle in most if not all cases so isn't really an issue but it does seem to just be there.
So i get from this youtube video that vsr works in realtime on streamed videos but is it somehow possible to use this vsr tech to batch process old digitalized vhs recordings on the computer?
You should take a high quality recording and make purposely bitcrushed and/or downscaled versions of it, that way you can compare the upscale to the original and determine how close the upscalers are able to get to the original HQ image, rebuilding from far less/worse.
Would you compare it against other realtime upscalers such as FSRCNNX
What I have observed, with the new update: my desktop GPU usage has risen from 12-16Watt to 40Watt (from 25 celsius to 36 celsius) without any app enabled. I use 3060ti.
It's just 2.5X power usage, nothing to worry.
impressive stuff! i wish it wasn't limited to 30 series and newer though... i there any technical explanation for this or is it just another one of nVidia's many money grabs?
Only rtx cards have tensor cores, and rtx2000-will might get support later, sems reasonable to me
@@jakobmod9881 i knew it was because of the tensor cores but i wasn't sure why they wouldn't support the 20 series from day one. That's what most people have after all, right?
How can you test the feature so easily without needing to toggle it on and off?
This looks like the same technology that my Nvidia Shield uses to upscale the image to my TV (4k 46"). Two years ago it was a bit of rubbish, yes it made the image look sharper but there was allot of highlights that where pulled into the extreme and there was a nasty smear when the image moved to fast. Nowadays this has improved massively and I could not live without it. The difference with it on and off is night and day and with off I would think that I would need glasses because the image is so blurry.
Funny that you mention that you think this technology works best on low resolution content to make it look more clear. The biggest improvement for me (mind you, watching the content on a TV screen and not a smaller computer screen) is when 720P or 1080P content is upscaled to roughly 4K. Yes the old family video's that my dad digitalized into 480P look better however it is still blurry as expected. While the sharpness and clarity of 1080P streaming content is improved massively.
Moomins in a 2kliksphilip video? That's a crossover I didn't expect!
2kliksphilip should become the upscaling and techie video channel
we need an hour long of "philip dyer proudly presents *something*" appearing out of different places and in different fonts and on different backgrounds.....
The color differences are the most striking effect of VSR for me. The castle in the fly-through near the end of the video has quite a change in the hue after VSR is applied. It's quite green-ish before, and gray-ish yellow afterwards. Is the algorithm doing more than just increasing visible detail, and playing with colors to make things look more "realistic?"
May be it's changing colours so that people.feel it has made some change .
I think it plays with contrasts as well, and contrasts can change the colors a bit.
On an old laptop (i5-4200/GT750M/8GB DDR3) instead of my main PC (R5 5600X/RTX3060Ti/32GB DDR4), getting super excited to try this out soon at "RTX 3000 [...] cards" - cause I never noticed that option before, having the card since ~2 years - only to get fatally struck in the heart seconds later at "Chrome-based browsers". I have to recover from this emotional whiplash...
Edit: Also you wanting to do shorter videos is apparently absolutely horrendous - cause it leads to amazing things like at 1:33 - good to know that you know how to enable such a really useful thing, but I expected you to quickly and easily tell us, well, *how to do the thing* - saving us from having to research and relearn everything you learned already, independently.
No rejoicing here.
On which video players is VSR working? I can't find any info on this and I'll never watch any actual movies or shows on browsers because of judder.
Have an addiction that brings joy to others... Also Moomin where a surprise.
Neither edge or brave seems to work for me, which is very strange as i have the latest update but it's not between the brave//:gpu thing either
Hi, you mentioned that you know this can be used in video players. I’m looking for a way to use VLC with real time upscaling and I was not succesful till now. Where do you think I could find help or another player that can do it? Thank you
There's a fork of MPC-HC that uses VRS.
@@emit... Thank you very much! I’ll try that. :)
@@emit... Any way to use it with SVP 4?
@@emit... link?
@@shimigami92dk Google it, links are flagged as spam on TH-cam.
I noticed that It's works pretty good with text. Videos like programming tutorials are so much clearer.
i'm using 4x upscale and i can't really see difference unless i look at it side-by-side with magnifying glass :/
Edit: Besides, it uses like 80% gpu usage with rtx3070, so there is gonna be fan noise while watching videos... Are we moving backwards?
Besides, if you have multimonitor setup and want to watch something in the background while playing ex twitch, it's a no no.
This is a game changer ON ANIME VIDEOS, ITS AMAZING!!!
2kliksphilip keeps saying "massive improvement" and "works wonders" when I can barely even tell any difference. The text looked better when zoomed in, and the mosaic blocks on the stair example looked much smoother, but those were the most significant thing I saw.
I'm glad to hear this is on the 3000 series!
Not so glad to hear that it apparently is not coming to notebooks?!
I am slowly starting to learn that nvidia isn't all about gaming, but also kinda everything else. For general use, they've made this featur. For renders, they've just been super efficient at that, always beating amd in that field. It's pretty impressive how much they have been able to do in the past few years, can't wait to see what they do next!
watching this with vsr already enabled is a surreal experience
Unless you play the video at 1440p, then it leaves the artifacts in place and doesn't enhance them
Would love to see multiple generations of VSR applied. What does 20x look like?
looks like it's improving stuff by 5% but well if we get to a point where we need 5% extra, this will be the go-to
Love u for ur ironic videos
DlSS still has to be implemented by the game, but the existence of VSR implies that it should be possible to scale up any game(it works with any game footage evidently). The only reason against I can imagine is latency.
But I am impressed and surprised, that VSR handles snow so well. DLSS3 struggled massively with rain in Hitman, although it is interpolating whole frames. Also the gradient removable is a joy to see. It still bothers me in even Netflix shows in dark scenes.
Wonder how much tech this shares with the upscaling in the shield.
There's a way to disable that first Windows 11 right-click menu so it always goes to the old menu first, look it up :).
I watched this video to see how good the RTX video super resolution is then noticed that I can see barely any difference while @2kliksphilip said there's a noticeable difference.
Then I realized I just turned on RTX VSS, lol. I turned it off then immediately saw the difference. The fact it can fix the problematic parts and make it look very similar to the enhanced parts really proves the effectivity of this feature.
Imagine watching Peep Show with this, you know, that super rare upscaled klikedition
*slightly increased contrast* ~ i died
05:15 You can say it actually takes AWAY extra detail (the blocks ARE details to our eyes) while it creates more REAL details which looks smoother, relevant and true.
bro you know what he meant dumbass
As someone who does consume a great deal of 1080p Japanese Cartoons on a 4K TV, I'm excited to myself evaluate the efficacy of this tech in this use case.
In my initial impression as of now, I am not overwhelmingly impressed even though I do appreciate that a significant difference is achieved.
For the past year or so I have been using a different upscaling solution for Anime, which is a set of GLSL shaders running in MPV (a project called Anime4K), and the result achieved by the HQ preset of this tool is a good step above what VSR can provide, in my opinion.
VSR does provide an image that I'd argue is more authentic to the original look, which I am sure would be appreciated by some people. Anime4K creates a more noticeably artifical sharpness that I know many viewers find too clean, but personally this is kind of exactly the thing I'm looking for.
I'll likely be sticking to Anime4K for my typical viewing, but I'm glad to have another tool to play around with.
What is the Skyrim orchestration used for the first part of the video?
I saw almost no differences in your ON/OFF comparison shots, then I remembered I had VSR on......🤣🤣
I wonder if this will be rolled out to Nvidia Shield tv units? If the old hardware can handle it, cause it's upscaling was already good.
I LIKE IT!
I tried the VSR at 1 and found near no difference and at 4 the whole image looked smudged and waxy while playing a 720p video at 1080p display. Nvidia should give its users a conversion tool to use this tech to upscale low res videos. I used Magpie upscale utility and found the quality to be a bit better using Nvidia vsr at level 4.
do i have to turn on hardware acceleration in my browser because i cant notice the difference when i test it out
I'll be honest, and maybe this is just me and the device I'm viewing this on, but the differences in most of these shots really aren't that noticeable at 1080p unless you're REALLY looking for them.
I think the best use for this upscaler is going to be computer tutorial videos. Even in a lot of 1080p videos I find that the elements you're meant to be focusing on just seem too small and low detail, and it seems like this upscaler performs the best with these sorts of elements and circumstances.
Dude, 1080p doenst work. I cant see difference.
What is the music at 8:00? It sounds VERY Deus-Ex ~esque.
Wait you can get it to work on viseo players? How everywhere I look claims it only works in browsers.
You test the tech by Nvidia with game play footage? Give it some old home movies or something.