This forum uses cookies
This forum makes use of cookies to store your login information if you are registered, and your last visit if you are not. Cookies are small text documents stored on your computer; the cookies set by this forum can only be used on this website and pose no security risk. Cookies on this forum also track the specific topics you have read and when you last read them. Please confirm whether you accept or reject these cookies being set.

A cookie will be stored in your browser regardless of choice to prevent you being asked this question again. You will be able to change your cookie settings at any time using the link in the footer.

Request: Improving RealSR quality
#1
Recently I found the following spin-off of the project RealSR: https://github.com/xinntao/Real-ESRGAN

The project is called Real-ESRGAN, and there is not a specific Vapoursynth filter, but the models are "compatible" with the models used by RealSR.

The models are included in the distribution: https://github.com/xinntao/Real-ESRGAN/r...indows.zip

And are the following:

realesrgan-x4plus (for real-life video upscaling)
realesrgan-x4plus-anime (for anime video upscaling)
realesrnet-x4plus (model trained on DIV2K dataset)

the realesrgan-x4plus is probably the best model for upscaling videos (at cost of speed).

To test the model i renamed "realesrgan-x4plus" in "x4" and then I override the files in "Hybrid\64bit\vsfilters\ResizeFilter\RealSR\models\models-DF2K_JPEG".  Given the compatibility with RealSR this was the easiest solution to use hybrid to test the model.

To test the model I downsized a short movie (20s) to the resolution of 640x346 (ratio 1.85:1) and then I resized it to 1920x1040.

This is the image resized with Lanczos4

[Image: Video-Test-640px-Lanczos-25.png]

This is image is very near to the source (fake Blu-Ray) since I used for testing a clip of the movie "28 Days Later" that was filmed using a Canon XL-1s standard-definition camcorder at 720x576 resolution and probably the Blu-Ray was obtain by up-scaling with Lanczos (or something similar) the original movie.

The following picture was obtained using RealSR included in Hybrid

[Image: Video-Test-640px-Real-SR-25.png]

And finally this is the picture obtained using realesrgan-x4plus

[Image: Video-Test-640px-Real-Esrgan-25.png]

As it is possible to see it is not necessary to perform 4x zoom to observe the details, the difference is very clear and the up-scaled image with realesrgan-x4plus contains more details than the original movie.

REQUEST

It would be nice if Hybrid will include in RealSR filters also the models described above:
  • realesrgan-x4plus
  • realesrgan-x4plus-anime
  • realesrnet-x4plus


Thanks
Reply
#2
Hybrid does support https://github.com/HolyWu/vs-realesrgan/ which is a Vapoursynth port of that project in it's torch addon (before I named it VSGAN addon).
-> nothing to do Smile
I also posted some info how I build the addon, see: https://forum.selur.net/thread-1858-post-13770.html, I just don't offer the addon as a general download since it's 10GB atm. and having tons of bots&co download that would kill the small (and cheap webserver the forum and the main page are hosted).

Cu Selur
Reply
#3
Hello Selur !

   The RealESRGAN resizer available in the last dev-version was exactly what I was looking for. You are always one step ahead!

   The quality of output is almost the same (maybe even better) of the one obtained by using realesrgan-x4plus model with the RealSR filter. But the RealESRGAN resizer is about twice faster (0.80fps vs 0.40fps). But even better the RealESRGAN resizer has the 2X model (scale=2), and using this model the speed increase to 3.14fps.

   I have always complained that good AI resizers are too slow to be used for upscaling long videos, but this is not more the case with the Real ESRGAN resizer.

Many thanks Selur! Smile Smile Smile
Reply
#4
Hello Selur!

  just for comparison this is the same frame encoded using RealESRGAN_2X

[Image: Video-Test-640px-Real-Esrgan-2-X-25.png]

  the quality is in between the one obtained using RealESRGAN_4X (the best) and RealSR_4X but RealESRGAN_2X is about 4 time faster than RealESRGAN_4X and the small decrease in quality is acceptable.

Thanks again! Smile
Reply
#5
Happy RealESRGAN work for you. Smile
You might also want to test some of the other resizers. Wink

Cu Selur
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)