Philip Hofmann
Philip Hofmann
  • 35
  • 34 049
Upscale September 24 Update
What i am currently up to in my sisr upscaling model training hobby / journey ;)
(Best to ask questions in the discord communities, more people that can answer and know more then me, for example umzi about dysample or about mosr and spanplus and musl about realplksr)
0:00 My Models python download script
2:55 Age of Mythology Retold model
7:17 New networks in the community
11:48 Flux Controlnet Upscaler
16:23 HQ-50K Dataset curation rundown
17:06 HQ50K: Tiling
18:26 HQ50K: File size
18:43 HQ50K: Blockiness
22:15 HQ50K: IQA
25:50 HQ50K: Complexity
27:03 HQ50K: Finishing
27:46 LSDIR curation
28:24 Testing / Assessment (ongoing)
Ah yeah maybe useful links:
[My models repo](github.com/Phhofm/models?tab=readme-ov-file#released-sorted-by-new)
[The flux controlnet upscaling huggingface space](huggingface.co/spaces/jasperai/Flux.1-dev-Controlnet-Upscaler)
[Referenced DiverSeg Paper](arxiv.org/pdf/2409.00768)
[Blockiness scoring code](github.com/gohtanii/DiverSeg-dataset/tree/main/blockiness)
[Complexity scoring code](github.com/tinglyfeng/IC9600)
[Qalign scoring code](github.com/chaofengc/IQA-PyTorch)
[neosr trianing framework](github.com/muslll/neosr)
[traiNNer-redux training framework](github.com/the-database/traiNNer-redux)
[the pytorch inference benchmark](github.com/the-database/traiNNer-redux/wiki/PyTorch-Inference-Benchmarks-by-Architecture)
[Enhance Discord](discord.gg/q593VfcDW7)
[neosr Discord](discord.gg/YtugFWp2FM)
[PLKSR](github.com/dslisleedh/PLKSR)
[RealPLKSR](github.com/dslisleedh/PLKSR/issues/4)
[MoSR](github.com/umzi2/MoSR)
[SPANPlus](github.com/umzi2/SPANPlus)
[chaiNNer](github.com/chaiNNer-org/chaiNNer)
[spandrel](github.com/chaiNNer-org/spandrel)
มุมมอง: 114

วีดีโอ

Training an upscaling model with neosr
มุมมอง 5734 หลายเดือนก่อน
Showing and explaining my workflow of preparing, training and publishing a transformer upscaling model with a training framework called neosr. openmodeldb link to released model: openmodeldb.info/models/4x-Textures-GTAV-rgt-s Another version of this model could be trained with dithering and maybe BC and DXT compression added to the lr. Watching my previous training videos would show things I le...
Upscale February 24 Update
มุมมอง 7507 หลายเดือนก่อน
There is a lot of progress in the super resolution / upscale topic, so I wanted to make a newer video since my last video of the FaceUp dataset preparation I made. I share some thoughts, new codes like neosr, and took the opportunity to show my experiments / things I tried out in this topic since I started training models. Hope this vide is informative or simply giving ideas of what one could e...
Dataset Preparation for Training Upscaling Models
มุมมอง 3.5Kปีที่แล้ว
Sections 0:00 Updates / Latest 9:38 Dataset preparation part This video basically accompanies the release of my 4xFaceUpDAT models, I wanted to show the difference to the 4xFFHQDAT models I had already previously released, since the difference mainly exists in dataset preparation. This is the process that I used for creating the FaceUp dataset out of FFHQ. Since I am constantly learning, this p...
Training an image upscaling model
มุมมอง 2.3Kปีที่แล้ว
This is a follow up video to the previous one (th-cam.com/video/l_tZE5l90VY/w-d-xo.html) where I showed how to train a Real-ESRGAN Compact (SRVGGNet) model, now showing how I train models of other networks (HAT, SwinIR etc) while using the same codebase. The good thing is there are multiple errors coming up during this showcase/ explanation, which is a good thing for a youtube video I believe b...
How to train an Real-ESRGAN Compact (SRVGGNet) model
มุมมอง 5Kปีที่แล้ว
After showing how to use chaiNNer to upscale images with models, this is meant to show how one can train such an upscaling model oneself locally, using the Real-ESRGAN repo code. I only real quickly touch on online training, I did not include a tutorial for those just showed possibilities. But you simply do the same steps like when locally training: Cloning the repo/codebase, installing depende...
How to upscale images with chaiNNer
มุมมอง 11Kปีที่แล้ว
This is meant as a simple introduction of how to use chaiNNer with some base-functionalities (there is a lot that could be done with chaiNNer). A lot of community trained models can be found on openmodeldb.info (my self trained models on there are the ones 'by Helaman') chaiNNer website: chainner.app/ open model database: openmodeldb.info/ SwinIR-L model: github.com/JingyunLiang/SwinIR/releases...
Met AI Bilder vo sich selber generiere
มุมมอง 124ปีที่แล้ว
Hello I dem video zeig ich der wie du dis eigete Modell chasch met dreambooth traininere so dass du met ai chasch bilder vo dir selber generiere ;) Da sind alli links: Birme: www.birme.net/?target_width=512&target_height=512 Dreambooth Colab: colab.research.google.com/github/ShivamShrirao/diffusers/blob/main/examples/dreambooth/DreamBooth_Stable_Diffusion.ipynb HuggingFace: huggingface.co/ Hugg...
Es DeepFake erstelle
มุมมอง 99ปีที่แล้ว
Säli Ide letschte Videos hani zeigt wieme met AI chan Bilder generiere und Videos vergrössere. Jetzt hani denkt zeigi na wieme chan es DeepFake erstelle damet du das selber mal usprobiere chasch oder denne en iblick bechunnsch i was es bruucht zum es DeepFake zerstelle. Programm: github.com/iperov/DeepFaceLab
Mit AI Videos vergrössere
มุมมอง 249ปีที่แล้ว
Hallo I dem Video zeig ich dir wie du chasch Videos met gringer uflösig (144p, 240p, 260p, 480p oder 720p) vergrössere/uspcale. D Resultat sind am Endi vo dem Video. D Unterschied sind besser erkennbar ufemne grosse Bildschirm (anstatt Natel) und hoher qualität (1440p) igstellt zum das Video luege. Die Video-Bispel sind 2x upscaled (d.h. 720p zu 1440p) mit entweder Real-ESRGAN (förd film) oder ...
Mit AI Bilder Vergrössere
มุมมอง 116ปีที่แล้ว
Hallo :) I dem Video zeig ich der wie du dini (generierte) Bilder chasch vergrössere ohni das si verpixle - met AI Upscaling. Video zu wiemer eifach mit AI Bilder generiert: Da es paar Gratissitene: Zyro zyro.com/tools/image-upscaler Upscale Media www.upscale.media/upload Bigjpg bigjpg.com/ Waifu 2x waifu2x.io/ waifu2x.udp.jp/ waifu2x.org/ Deepai deepai.org/machine-learning-model/torch-srgan An...
ESRGAN Universal Models Visual Comparison
มุมมอง 4.5Kปีที่แล้ว
Update Section 10.Nov 2022: I had been working on a website that features more such examples with public models as in this video. Set 4 in the Multiple Models subpage is the newest and most extensive with ~300 models. The examples in this video are Set 1. The Webpage is here: phhofm.github.io/upscale/introduction.html End Update Section Hello :) Intro: Since the upscale wiki contains a lot of p...
Eifach met AI Bilder generiere
มุมมอง 312 ปีที่แล้ว
Säli I dem Video zeig ich wie du mit es paar websitene eifach chasch AI Image Generators usprobiere. Da sind d Links zude zeigte websitene: Stable Diffusion: huggingface.co/spaces/stabilityai/stable-diffusion Dall-E Mini: huggingface.co/spaces/cye/dalle-mini Midjourney: www.midjourney.com/home/ Prompt Generator: huggingface.co/spaces/Gustavosta/MagicPrompt-Stable-Diffusion Face Restoration: GFP...
Retexture old games with Stable Diffusion? (Freedoom example)
มุมมอง 1.3K2 ปีที่แล้ว
Hello There :) I was just curious and wanted to test out if with the rise of those AI Generators we could simply regenerate old textures of old games instead of upscaling them, and used the Freedoom project to try it out as a running example (Basically AI Generation instead of AI Upscaling). This all is just Quick&Dirty, I just placed the textures in exactly as they were generated. If we would ...
Lord of the Rings Rise to War - Commander: Legolas
มุมมอง 4112 ปีที่แล้ว
We are going to have a look at the commander Legolas, his design and what Skills, Items and Units I recommend on running with him. Timestamps: 00:00 Intro 00:13 Respect Item 00:56 Classification 04:11 Skills 09:04 Items 12:17 Core Unit 1 12:41 Input on Countering 17:37 Core Unit 2 18:25 Third Unit Defensive 20:22 Hard Counter to this Build (or any high physical damage dealing commander) 21:43 T...
Lord of the Rings Rise to War - Challenge System
มุมมอง 992 ปีที่แล้ว
Lord of the Rings Rise to War - Challenge System
Lord of the Rings Rise to War - Countering Rohan
มุมมอง 9802 ปีที่แล้ว
Lord of the Rings Rise to War - Countering Rohan
Bad Ragaz 2022
มุมมอง 892 ปีที่แล้ว
Bad Ragaz 2022
Lord of the Rings: Rise to War Tipps
มุมมอง 8622 ปีที่แล้ว
Lord of the Rings: Rise to War Tipps
Unter 200 Franken Billig PC Build Schweiz 2021
มุมมอง 683 ปีที่แล้ว
Unter 200 Franken Billig PC Build Schweiz 2021
League of Legends One for All Malphite Yi
มุมมอง 183 ปีที่แล้ว
League of Legends One for All Malphite Yi
Tessin 2021
มุมมอง 1363 ปีที่แล้ว
Tessin 2021
Binance
มุมมอง 93 ปีที่แล้ว
Binance
Timeline Project
มุมมอง 4373 ปีที่แล้ว
Timeline Project
Snowboard Adelboden 2021
มุมมอง 653 ปีที่แล้ว
Snowboard Adelboden 2021
Alte langsame Windows PC schneller mache
มุมมอง 203 ปีที่แล้ว
Alte langsame Windows PC schneller mache
Legal History Timeline Prototype
มุมมอง 133 ปีที่แล้ว
Legal History Timeline Prototype
FocusSession Masterthesis
มุมมอง 763 ปีที่แล้ว
FocusSession Masterthesis
Tessin 2020
มุมมอง 193 ปีที่แล้ว
Tessin 2020
Sieben Hengste 2020
มุมมอง 1613 ปีที่แล้ว
Sieben Hengste 2020

ความคิดเห็น

  • @user-fo9ce3hr5h
    @user-fo9ce3hr5h 7 วันที่ผ่านมา

    where should i put that pth file in comfy ui?

  • @alexitport1512
    @alexitport1512 13 วันที่ผ่านมา

    Wow... Outstanding work, congratulations! And thank you very much!

  • @superlucky4499
    @superlucky4499 16 วันที่ผ่านมา

    I learned so much from using your models and new watching your videos. Thank you! Please keep making them!

  • @c-domination
    @c-domination หลายเดือนก่อน

    Is it weird that is taking so long to upscale a pic?

  • @abubakarsaleem5167
    @abubakarsaleem5167 หลายเดือนก่อน

    Hello Sir, Could you please guide me how can i use early stopping during the training of Real-ESRGAN?

  • @Zanarkand_0
    @Zanarkand_0 หลายเดือนก่อน

    couldn't get the model to load. just says this node is currently running indefinitely, but thank you though. because i am upscaling a game texture, I just wasted a whole heap of time thinking it needed the in game model the texture it was attached to.

  • @Scorpiomaj27889
    @Scorpiomaj27889 หลายเดือนก่อน

    This has been great for me for upscaling videos. However I don't think you showed the audio part. After you upscale the frames (Real ESRGANx4 for me) and use LOAD IMAGES for the new frames, you ALSO can use LOAD video and dump both the frames AND the audio track to the SAVE VIDEO node. (Assuming you pulled all frames from the source, saving them out, the audio is perfectly in sync.) For large video upscaling jobs, extract the source frames, start TEN instances of chaiNNer and for the LOAD IMAGES, use WCMatchGlob expression "*0.jpg" for the first instance of chaiNNer, "*1.jpg" for the second instance and so on... a clunky way of parallel threads without file access conflicts.

  • @emirdinc826
    @emirdinc826 หลายเดือนก่อน

    Hey Philip, my validation from the config file is not working and not showing up on my logger but it does not give me any error as well but doesn't work no matter what I tried with training the Real-ESRGAN model. Any advice on how to resolve it?

  • @quendi9381
    @quendi9381 2 หลายเดือนก่อน

    It's been a long time since I've seen such a beautiful linux ui interface.

  • @saadfarah-vp4cq
    @saadfarah-vp4cq 3 หลายเดือนก่อน

    Hi sir, can you please share with me you kaggle notebook to train my own model and validate it into kaggle ??

  • @Fera94x
    @Fera94x 3 หลายเดือนก่อน

    Hi! I just found you during a deep dive into this entire topic. I enjoy restoring older images in my spare time and up until this point I've exclusively used Adobe products. Your content is incredibly helpful for a 'newbie' like me. Thanks!

    • @Fera94x
      @Fera94x 3 หลายเดือนก่อน

      I subscribed hoping to see more of you in the future 🤗

    • @reasonsreasonably
      @reasonsreasonably 2 หลายเดือนก่อน

      Ween yourself off of the Adobe products. They don't deserve all of your money, IMO. There are very good alternatives and even better ones. Good luck!

  • @hoangdainguyen9991
    @hoangdainguyen9991 3 หลายเดือนก่อน

  • @johnrambo5906
    @johnrambo5906 4 หลายเดือนก่อน

    Thanks for the tutorial.

  • @stable_contusion
    @stable_contusion 4 หลายเดือนก่อน

    how i can find you discord?

  • @farukish
    @farukish 4 หลายเดือนก่อน

    Great video !

  • @RetroBulgaria
    @RetroBulgaria 5 หลายเดือนก่อน

    Hey, bullshit stupid guy, why you think that we must watching your nonsence video in order to understand how to upscale with chainner? Yes, western morons that dont know nothing more than youtube and tiktok may be it will be interesting, but there are still outside western morons normal people that hate you and such stupid peoples that make money on things that other smart peoples (chainner) done. And you use the worst models that are only for moronic digitally born photos and not for real world photos. But that is maximum what morons can do.

    • @RetroBulgaria
      @RetroBulgaria 5 หลายเดือนก่อน

      I dont care about west peoples and their shitty language. So, I know enough English, but don't But I'm not trying hard enough

  • @Beauty.and.FashionPhotographer
    @Beauty.and.FashionPhotographer 5 หลายเดือนก่อน

    what do you think of github Image-Super-Resolution-via-Iterative-Refinement ?

  • @RADEONR
    @RADEONR 5 หลายเดือนก่อน

    how much ram do u installed here?!

  • @weebgrinder-AIArtistPro
    @weebgrinder-AIArtistPro 5 หลายเดือนก่อน

    Keeping that CFG scale high and denoise level low ;) This is pretty neat. Anything where generative AI and game development/modification intersect is pretty interesting.

  • @MelizzanoDaquila
    @MelizzanoDaquila 5 หลายเดือนก่อน

    I've been looking for these upscale models " 100k [epoch 507, psnr 30.517, ssim 0.83536, lpips 0.031511] or 150k [epoch 760, psnr 31.331, ssim 0.84292, lpips 0.029] " and I can't find them, do you have a link to them?

  • @MelizzanoDaquila
    @MelizzanoDaquila 5 หลายเดือนก่อน

    But what about a sequence of images (.exr)? Won't it create artifacts or difference in frames? Or would I have to transform the Sequence into a video and then use ChaiNNer?

  • @vitaliyklitchko6664
    @vitaliyklitchko6664 5 หลายเดือนก่อน

    For now (April 2024) Gigapixel AI is still much better in upscaling and face restoring...

  • @abubakarsaleem5167
    @abubakarsaleem5167 6 หลายเดือนก่อน

    Thanks for this amazing tutorial.Sir,could you please make a tutorial for the custom training of HAT model for image restoration.(HAT: Hybrid Attention Transformer for Image Restoration) I hope u will consider my request

  • @RobynsGrrls
    @RobynsGrrls 6 หลายเดือนก่อน

    Fabelhaft!! I can't believe this video (and the information that I found with it) is at least 6 months old... feels so NEW! Well, new to me. You've created some beautiful models (which I use in ComfyUI) - thank you for sharing your process. I'm currently using your 4xFaceUpLDAT model to great effect with UltimateSDUpscale. The setting need work but wow! how wonderfully this works!

  • @ultimategolfarchives4746
    @ultimategolfarchives4746 6 หลายเดือนก่อน

    I know your website since a while, but I didn't know you had a youtube channel. That's the most in-depth upscale video I've seen. Thank you sir 👌

  • @abubakarsaleem5167
    @abubakarsaleem5167 6 หลายเดือนก่อน

    Thanks for the video. Could you please tell me your GPU specifications? As i want to train my SR models on my local GPU.

  • @daniellee6912
    @daniellee6912 6 หลายเดือนก่อน

    thanks a lot for all the work and explanations

  • @gorohk
    @gorohk 6 หลายเดือนก่อน

    very good work, not only about work, also detailed about sources. Could u share your page link too.

  • @KintaroTakanori
    @KintaroTakanori 7 หลายเดือนก่อน

    züri.jpg :DDDD

  • @prchaser2081
    @prchaser2081 7 หลายเดือนก่อน

    what about how to run it in python or C++?

    • @Scorpiomaj27889
      @Scorpiomaj27889 หลายเดือนก่อน

      It runs on Pytorch, check the settings.

  • @Djonsing
    @Djonsing 8 หลายเดือนก่อน

    The update came out today, the program is great!

    • @JJ-vp3bd
      @JJ-vp3bd 6 หลายเดือนก่อน

      any info on that

  • @JessR-oo2zd
    @JessR-oo2zd 8 หลายเดือนก่อน

    Do you have .param or .bin versions of these models? I ask because Upscayl software allows you to upload custom models, but they must be one of these two. Thanks!

  • @___x__x_r___xa__x_____f______
    @___x__x_r___xa__x_____f______ 9 หลายเดือนก่อน

    My use case is upscaling skin textures from relatively smooth sdxl portraits where the face is a about 400px in height. I’ve been getting done interesting results either latent space upscaling, but if there’s a case to be made for this kind of upscaling model in comfyui using something like Ultimate SD Upscaling with spread cycles to actually generate skin texture? Does your model generate per se, or only extrapolate? That’s what in don’t understand…

  • @user-jp7vk3mn1l
    @user-jp7vk3mn1l 9 หลายเดือนก่อน

    This could work

  • @brennt501
    @brennt501 9 หลายเดือนก่อน

    amazing!!!

  • @ThaRealiestJEDI
    @ThaRealiestJEDI 10 หลายเดือนก่อน

    Hi, what is memory consumption for training? Let say for batch 2 & 4?

  • @andressamoro6110
    @andressamoro6110 10 หลายเดือนก่อน

    hey, i was wondering if you could lend a helping hand. I did the installation step by step as you did, and everything seem to be working just fine. However, when it starts to upscale it never really saves in the chosen directory. It keeps on trying to upscale forever. Do you have any tips on how to fix it? Thanks!

  • @ExploRideURBEX
    @ExploRideURBEX 11 หลายเดือนก่อน

    I have error when i try upscale face as in your video.: An error occurred in a Upscale Face node: Failed to run Face Upscale. Input values: • Image: RGBA Image 4096x4096 • Model: Value of type 'nodes.impl.pytorch.architecture.face.codeformer.CodeFormer' • Upscaled Background: None • Output Scale: 1x • Weight: 0.7

    • @Scorpiomaj27889
      @Scorpiomaj27889 หลายเดือนก่อน

      Most like the image is too large, in case anyone checks these comments.

  • @kaushal1001
    @kaushal1001 11 หลายเดือนก่อน

    Good video, thanks. I wanted to test your 4xFaceUpDAT model, and compare the results with the other ERSGAN based Stable Diffusion upscale models I've used (for ex. swinIR, 4x-UltraSharp, ERSGAN etc.). Would you happen to have any example .py code which I can reuse, to test this model please? I tried to use this model similar to the other SD models, but that obviously doesn't work because this is a DAT based model. I guess I can install ComfyUI etc., but would prefer doing this directly from .py scripts.

    • @KINGLIFERISM
      @KINGLIFERISM 11 หลายเดือนก่อน

      So glad I read this. I wish people would be clear on what works with what. the space is moving fast and not many know where things go

    • @kaushal1001
      @kaushal1001 11 หลายเดือนก่อน

      @@KINGLIFERISM yes, same. I found some script example in the original git itself, but couldn't make it work even after installing all the prerequisites. Had to abandon the project. For now I'm sticking to a combination of ESRGAN and 4x-UltraSharp, untill something better turns up

  • @BenLe42
    @BenLe42 11 หลายเดือนก่อน

    Such a great tool, but everytime I want to use it I can't, and have to wait for it to update python for an hour or three. By ther time it's done i dont' even need it anymore. Am I doing something wrong?

  • @gabimedia
    @gabimedia 11 หลายเดือนก่อน

    nice video

  • @gamingthunder6305
    @gamingthunder6305 11 หลายเดือนก่อน

    any chance you could add the training yml file for 4xNomos8kDAT ? i would like to train a model with 2x and 3x on my data. the model is really good and thank you for releasing it.

  • @prawnchips4659
    @prawnchips4659 11 หลายเดือนก่อน

    Good video. Thanks.

  • @TheLofiJukebox
    @TheLofiJukebox ปีที่แล้ว

    Colab-trainner only gives me errors. Someone knows how to use it properly?

  • @still.rendering
    @still.rendering ปีที่แล้ว

    As someone not experienced with node programs I really appreciate the detailed directions and pacing. Thank you!!

  • @xSilVerTooTHx
    @xSilVerTooTHx ปีที่แล้ว

    does this work on live action footage? im only just started to learn using ESRGAN

  • @toddd.8496
    @toddd.8496 ปีที่แล้ว

    Thanks so much for all the work you did in putting the model comparison tools together too. That is pure gold!

  • @xzenor
    @xzenor ปีที่แล้ว

    This stuff is amazing! Thanks!

  • @nigamankit7
    @nigamankit7 ปีที่แล้ว

    Thanks for the video. Can we merge two different realesrgan models and combine their capabilities. Like combining anime and other comic art style ? If not what could be the possibilities ?

  • @devrishic
    @devrishic ปีที่แล้ว

    Looks like a nice detailed explanations...Is there a English version of this process. Can this be done through Chainner ?