This video is in 4K, view in 4K for the best quality. And feel free to comment down what you think! Remember to check out Yours App using this link: yoursapp.com/bycloud or use the code: BYCLOUD to save 60% off the yearly plan!
You should do this on fuzzier but clean anime like Ninja Scroll, and 80s anime like Bubblegum Crisis with its mechanical lines. Cowboy Bebops intro is already pretty damn clean.
@@TheFondalizer I mean what's the point of that then? If it's 1080p you'd find it on Bluray already. The biggest allure of this upscaling technology for me is bringing pre-HD into the modern era.
But Topaz has different models that are for different type of videos. If you try to use the same Topaz model used here for real footage then probably you will have bad results.
@@noxid86 lmao don't worry about venereal disease if you know what you are doing, I literally pirate all my games and softwares and haven't gotten a single problem ever. I don't even switch on my antivirus much, I can send you the torrent link if you want me to. 200 bucks is a lot for a software that you probably won't use much, I didn't even know it was 200 bucks, that's way too lot. Makes me more happy that I pirated it
So basically I have to use the one which doesn't cause issues with Bokeh first then use the one which doesn't produce artifacts and then use the one which can actually damn upscale the footage and then probably have to colour correct everything to the original since god know how it might turn out after three processes
@@yojumba no brother I've a rotten graphic card, I'm not using GTX but it's really fast with 3090. You should try with anything you're having 🍙 mine graphic card is ages old.
I can do the maths quickly for you. Let's say you are trying to upscale a generic 24 minutes episode, and let's say that the anime runs at 24 Frames a second. If you would do the sensible and logical thing, to parse it through Ffmpeg, (please, do *NOT* feed videos to image upscalers) since the episode has 24 minutes, every minute is made up of 60 seconds, and every second produces 24 Frames, 24x60x24, you would end up with 34.560 images. I believe it would take from a week, to 3 months to get the Final result. And here I'm talking about a generic late 90s,to early 2000s anime. The classical 600p 4:3 anime. Anime upscaling is fine for really old animations, like trying to restore classical 70s animations. I saw some amazing work restoring classical Chinese cartoons. If you were to try this with these crazy modern animations, that are 60 frames, and often 1080p, you would end up with triple the amount of images to upscale, with double the size. I'd wager you'll end up without storage before finishing it then. Even if you have some crazy RTX 3090 Ti Super Kingpin XXX RGB XL Black Founders Edition, I believe it's not worth the surprise electric bill by the end of the month. You can do it if you have like a Quadro A2000, very efficient CUDA for this kind of workload, or an AMD Vega 64/Radeon VII, very competent ROCm. Don't try anything too crazy on a consumer grade product. Believe me, I know. I'm currently working on PlayStation 2 upscaling, but on a limited CPU level, (running no more than 90w) and upscaling 150 KB textures can produce 2 MB results. I've dumped only 60% of the game, Upscaled over 16k images, and still have a lot of Mipmaps to dump.
ESRGAN 0.5FPS Real-ESRGAN 0.6FPS Real-CUGAN 4.5FPS Waifu2x 3FPS Topaz 2FPS All ran on a RTX3090 with VSGAN TensorRT Docker Didn't put it as a criteria because it's too easy to show what's good and what's not
NCNN is going through an optimization phase. The speeds of this test will be or maybe are already outdated (since today was released an optimization preview for tensercore). You should get different results with different GPU architectures.
I'm looking to upscale Kaiji anime from 720p to 1080p without affecting bokey, rounding sharp edges or introducious to much artefacts If someone can suggest me a model to work with thats suits the art style
Excellent video. Now... I can't figure out how to implement Real-Cugan at all. I can do it for images, but the process for making videos is not obvious to me without using ffmpeg and literally posting each frame and upscaling them. Could you point me in the correct direction?
@@matteoki6069 RealESRGAN is not really new, it's ESRGAN, but some layers got renamed. Data augmentation and losses get applied to work with real images, hence the name. There is no "RealESRGAN". "RealESRGAN_x4plus_anime_6B" is ESRGAN and "RealESRGANv2-animevideo" is SRVGGNetCompact, which isn't even ESRGAN. The naming is quite confusing.
@@Styler00Dollar They should really change name, it's like there's some developer civil-war and they decided to split up and make their own, but they can't redirect the marketing or fame so they name it real- that's what usually happens
-It doesn't.- -For images, you will get the best results with ESRGAN (Real works as well as it is basically the same). Each model is best for something else. You will have to experiment on your own to determine which works the best for each scenario.- edit: I completely missed bycloud mentioning it at the end of his video. My bad.
That's right, in this last version they fixed a lot of things that were wrong. It seems that Topaz copied the free models and adapted it so that it has many adjustments. Also, each anime has a different configuration.
I find it hilarious how even though people who watch anime are a small portion of the population...it takes up like 99% of the video upscale community. For every tutorial explaining REAL video upscaling...theres like 10 explaining anime upscaling...
![We had Image Gen copying LLM... and now the REVERSE?? [DiffusionLM]](/img/n.gif)
This video is in 4K, view in 4K for the best quality.
And feel free to comment down what you think!
Remember to check out Yours App using this link: yoursapp.com/bycloud or use the code: BYCLOUD to save 60% off the yearly plan!
Made a video on best AI video upscaler (not anime)😊
Can Real-esrgan upscale videos?
TH-cam makes you pay for this now :(
Any plans for 2023 top?
The criteria chapter names should be listed and render times as well
Would love to see a update to this 🎉
watching on 144p hits different
What
@@masterphil_what
it's really hard to upscale anime because right now there are a lot of different art styles and fx in anime. great vid!
much easier than any real world video, because it's primitive animation without details, complex gradients etc
@@deaddycruel Really depends on the series, a lot of anime have more complex animation than western animation
@@lyneo5807 bs and you know this.
I mainly wanna use these to cheat on my animating someday
being able to higher or lower stuff at will
You should do this on fuzzier but clean anime like Ninja Scroll, and 80s anime like Bubblegum Crisis with its mechanical lines. Cowboy Bebops intro is already pretty damn clean.
I hear it only works on 1080p so you can't use old anime
@@TheFondalizer I mean what's the point of that then? If it's 1080p you'd find it on Bluray already. The biggest allure of this upscaling technology for me is bringing pre-HD into the modern era.
Topaz is way better for when it comes to footage since that’s what it’s made for, god I love that software.
But Topaz has different models that are for different type of videos. If you try to use the same Topaz model used here for real footage then probably you will have bad results.
Topaz is 200 bucks :(
@@noxid86 pirate it ;-)
Cause I did it and it works wonderfully, upscaled some of my favourite anime clips/AMVs
@@jishan6992 lol thought about it but i haven't done that shit since I was 20 and I don't want internet herpes
@@noxid86 lmao don't worry about venereal disease if you know what you are doing, I literally pirate all my games and softwares and haven't gotten a single problem ever. I don't even switch on my antivirus much, I can send you the torrent link if you want me to. 200 bucks is a lot for a software that you probably won't use much, I didn't even know it was 200 bucks, that's way too lot. Makes me more happy that I pirated it
so now i can watch my old realmedia k-on episodes in 4k?
You can do that in real time with Nvidia gpu
@@flexzii6772 any gpu, you can easily run good upscaling methods in real time with a decent gpu, like a 4060
Im looking into better alternatives to Topaz for upscaling clean results for 80s western cartoons going from 480 to 4k.
Holy shitttttt I was not expecting this. ESRGAN def numba 1️⃣ 🏆
Yes you r right
From the result, yes but too bad I can't get it running yet 😢
The only thing I can suggest these developers are like a google Colab environment
It already exists.
So basically I have to use the one which doesn't cause issues with Bokeh first then use the one which doesn't produce artifacts and then use the one which can actually damn upscale the footage and then probably have to colour correct everything to the original since god know how it might turn out after three processes
Have you tried AI Image Enlarger which has 2 types of upscaling at 2x and 4x with one being up to 8x and the "anime version" up to 4x
real cugan for jack of all trades.
agreed.
i think waifu2x is still the best, yes its not as sharp but it still looks the most consistently good to me
But what looks the best with rubbish low res cartoons?
@@davidroberts3262 crt screen
Any possible update?
topaz it's very flexible, fast and adjustable. with certain settings you get all the results shown in the video.
Pity you didn't test "Anime4K" filter. I really wondering how much does it worse than not-realtime implementations
worse by a lot
I want some frame interpolation comparsion, please
can’t wait till these can run real time like madvr
I WAS LOOKING FOR SUMTIN TO UPSCALE FATE, TY
1. How well does it work with photos (meaning more realistic content) ?
2. Does it have a library that one can use for Java? Even on Android?
Is there a model that can eliminate bloom? Or a video editing technique?
is there a website (library) for upscaleded animes? or way to search for it?
Great video! I was just wondering how long will it take to upscale an anime episode with a rtx3090?
So good for you.. Mine takes 2 hrs for upscaling 3 sec literally
@@lorduchiha2242 No way! That's a crazy amount of time. I won't even try with my gtx 1050 ti :(. I suppose u used an rtx3090? Thx for the reply!
@@yojumba no brother I've a rotten graphic card, I'm not using GTX but it's really fast with 3090. You should try with anything you're having 🍙 mine graphic card is ages old.
@@lorduchiha2242 I see XD
I can do the maths quickly for you.
Let's say you are trying to upscale a generic 24 minutes episode, and let's say that the anime runs at 24 Frames a second.
If you would do the sensible and logical thing, to parse it through Ffmpeg, (please, do *NOT* feed videos to image upscalers) since the episode has 24 minutes, every minute is made up of 60 seconds, and every second produces 24 Frames, 24x60x24, you would end up with 34.560 images.
I believe it would take from a week, to 3 months to get the Final result.
And here I'm talking about a generic late 90s,to early 2000s anime. The classical 600p 4:3 anime.
Anime upscaling is fine for really old animations, like trying to restore classical 70s animations.
I saw some amazing work restoring classical Chinese cartoons.
If you were to try this with these crazy modern animations, that are 60 frames, and often 1080p, you would end up with triple the amount of images to upscale, with double the size.
I'd wager you'll end up without storage before finishing it then.
Even if you have some crazy RTX 3090 Ti Super Kingpin XXX RGB XL Black Founders Edition,
I believe it's not worth the surprise electric bill by the end of the month.
You can do it if you have like a Quadro A2000, very efficient CUDA for this kind of workload, or an AMD Vega 64/Radeon VII, very competent ROCm.
Don't try anything too crazy on a consumer grade product.
Believe me,
I know.
I'm currently working on PlayStation 2 upscaling, but on a limited CPU level, (running no more than 90w) and upscaling 150 KB textures can produce 2 MB results.
I've dumped only 60% of the game,
Upscaled over 16k images, and still have a lot of Mipmaps to dump.
2:00 what anime is that?
Anime4k can upscale in realtime, but I don't know how to export its video from MPV. Can you make a guide for that?
Which is the best for real life movies?
"Topaz can sit down cuz its not free" damn 💀
Which is the fastest.?
ESRGAN 0.5FPS
Real-ESRGAN 0.6FPS
Real-CUGAN 4.5FPS
Waifu2x 3FPS
Topaz 2FPS
All ran on a RTX3090 with VSGAN TensorRT Docker
Didn't put it as a criteria because it's too easy to show what's good and what's not
@@bycloudAI Waift2x on UpRGB mode is a lot faster than cunet or RealCUGAN but lower quality.
NCNN is going through an optimization phase. The speeds of this test will be or maybe are already outdated (since today was released an optimization preview for tensercore). You should get different results with different GPU architectures.
Hi can you suggest something really good for upscaling retro gameplay videos?
Can you do a video on what the best waifu4k fork is?
I'm looking to upscale Kaiji anime from 720p to 1080p without affecting bokey, rounding sharp edges or introducious to much artefacts
If someone can suggest me a model to work with thats suits the art style
whats best for mixed 3DCG & drawn anime like Initial D?
Please make a 2023 version, ai has changed alot since then!
Excellent video. Now... I can't figure out how to implement Real-Cugan at all. I can do it for images, but the process for making videos is not obvious to me without using ffmpeg and literally posting each frame and upscaling them. Could you point me in the correct direction?
Waifu2x gui can do that if you are still interested
Dude I need something like smart TVs AI for upscaling anime! can you help?
What
i have 8gbRAM, 512gbSSD with AMD graphics
can i use it ?
what model did you use for esrgan?
RealESRGAN_x4plus_anime_6B ESRGAN model
it's not Real-ESRGAN, it's pretty confusing naming method
@@bycloudAI Wait that model right there should not work with a normal esrgan build. It works with the realesrgan github page, i think you got it wrong
@@matteoki6069 RealESRGAN is not really new, it's ESRGAN, but some layers got renamed. Data augmentation and losses get applied to work with real images, hence the name. There is no "RealESRGAN". "RealESRGAN_x4plus_anime_6B" is ESRGAN and "RealESRGANv2-animevideo" is SRVGGNetCompact, which isn't even ESRGAN. The naming is quite confusing.
@@Styler00Dollar They should really change name, it's like there's some developer civil-war and they decided to split up and make their own, but they can't redirect the marketing or fame so they name it real-
that's what usually happens
Really cool
Hey, bycloud, can you give us a link to this "ESRGAN training community" that you've mentioned? 7:56
check out the description
@@bycloudAI thx
2023?
Also what do you think about using Marseille Mclassic for anime
Can I use an AMD GPU for this?
Nope
you can use the ncnn
@@SuperObamaladen Stop lying
7:56 jesus and the infant son! please use dark reader extension my eyes are broken
bro can i use rtx 3060 for this upscaling
En topaz corre a 4.5fps de 1080 a 4k.
Which is best for images?
the same reasoning from the video applies
-It doesn't.-
-For images, you will get the best results with ESRGAN (Real works as well as it is basically the same). Each model is best for something else. You will have to experiment on your own to determine which works the best for each scenario.-
edit: I completely missed bycloud mentioning it at the end of his video. My bad.
I think real esrgan is best
Topaz is more customizable, and if used correctly, it is way better than others
That's right, in this last version they fixed a lot of things that were wrong. It seems that Topaz copied the free models and adapted it so that it has many adjustments. Also, each anime has a different configuration.
topaz isn't the best when it comes to cartoons
hi
Came here to try upscale fate.. man has fate for the checks.
#winning
Rint test
Esrgan is really slow though
I find it hilarious how even though people who watch anime are a small portion of the population...it takes up like 99% of the video upscale community. For every tutorial explaining REAL video upscaling...theres like 10 explaining anime upscaling...
Gotta speak up man, I can’t even hear you on max volume iPhone 12.
first, also holy shi-
vanceai is base on Waifu2x i have no idea what did they add to it becuase is not opensoruce code and also not free