Deoldify Vapoursynth filter

[Dan64]

Wow! vs-realesrgan v5.1.0 is much faster.
On my PC with RTX3060 the speed increased from 12.95 fps to 30.38 fps (num_streams=3, num_batches=1) an increase of about 2.3x.

With num_batches=2 (num_streams must be =1 to improve the num_batches performance) the speed increased to 34.15 an increase of about 2.6x.
Probably due to my poor GPU I don't have observed any advantege in using num_batches > 2.

In any case it is an incredible result, with this speed it is possible to perform the resize with RealESRGAN in real-time.
I remember the times where the resizing speed of RealESRGAN was about 3/4 fps.

Dan


P.S.
Using the version 5.1.0 is displayed the following message:

Unable to import quantization op. Please install modelopt library (https://github.com/NVIDIA/TensorRT-Model...stallation) to add support for compiling quantized models

[Selur]

Using the version 5.1.0 is displayed the following message:

Unable to import quantization op. Please install modelopt library (https://github.com/NVIDIA/TensorRT-Model...stallation) to add support for compiling quantized models

=> you would have to ask HolyWu about that. (got everything installed that was listed in README)

Cu Selur

[Dan64]

Using the version 5.1.0 is displayed the following message:

Unable to import quantization op. Please install modelopt library (https://github.com/NVIDIA/TensorRT-Model...stallation) to add support for compiling quantized models

=> you would have to ask HolyWu about that. (got everything installed that was listed in README)

issue open: https://github.com/HolyWu/vs-realesrgan/issues/31


Dan

EDIT:
HolyWu answer: None of ModelOpt's functionality is used so you can safely ignore that message.

[Dan64]

HI

ImportError: DLL load failed while importing spatial_correlation_sampler_backend: The specified procedure could not be found.
....
....
import spatial_correlation_sampler_backend as correlation
ImportError: DLL load failed while importing spatial_correlation_sampler_backend: The specified procedure could not be found.

Try to install the spatial correlation package: spatial_correlation_sampler-0.5.0-py312-cp312-win_amd64_torch-2.6.0.dev20241101+cu124.whl.zip
You need to extract the content of the archive in ".\Hybrid\64bit\Vapoursynth\Lib\site-packages" and override the files previously installed by Hybrid.

---

Hello Selur,

  the spatial_correlation_sampler available in the last torch package is wrong is the spatial_correlation_sampler-0.5.0-py312-cp312-win_amd64_torch-2.5.0.dev20240707+cu124, that is not compatible with torch-2.6.0.dev20241109. The correct version in available in the last torch package, but is installed in the wrong location ".\Vapoursynth" instead of ".\Vapoursynth\Lib\site-packages\". 
  Please fix it.

Dan

P.S.
I also provided the link to the correct version in the answer to "hallomanbh"

[hallomanbh]

spatial_correlation_sampler_backend 

yes replaced with new files . working without errors . i will try Exemplar Models " ColourMNet " with Ref Frames. thankyou

[hallomanbh]

[Selur]

The correct version in available in the last torch package, but is installed in the wrong location ".\Vapoursynth" instead of ".\Vapoursynth\Lib\site-packages\".

Updated the torch-addon to fix this.

[Dan64]

You need to set the method "HAVC + RF same as video" but in my opinion better results are obtained using "HAVC + RF different from video" as shown in the pictures below





Dan

---

Hello Selur,

  I noted that you removed the flag "Reference Frames only".

 

  I know the reasons for the removal, but this flag is useful for a more advanced colouring process.
  I understand that this filter is quite complex to use, this complexity is also due to the fact that Hybrid is suitable mainly for advanced users.
  I'm planning to write a Colouring Guide for using HAVC in Hybrid to simplify the usage of this filter and reduce its complexity.
  Allowing people with no experience of Vapoursynth and Hybrid to use HAVC.  
  In order to simplify the usage to people with little knowledge of Vapoursynth it will be very useful if you can introduce again in Hybrid the flag "Reference Frames only".
  This flag should be enabled when "Ref FrameDir" is set (not empty).

Thanks,
Dan

Hello Selur,

  in my previous post #773 I asked you the possibility to re-add the option "Reference frames only", but never answered to my post.
  I think that now there is a lot of room in the GUI for adding this option.
I also noted that once the field "Ref FrameDir" is set, there is not way to clear it (set it to null), could add this feature ?

Thanks,
Dan

---

The correct version in available in the last torch package, but is installed in the wrong location ".\Vapoursynth" instead of ".\Vapoursynth\Lib\site-packages\".

Updated the torch-addon to fix this.

  Now is working!

Thanks,
Dan

[Selur]

Hello Selur,

in my previous post #773 I asked you the possibility to re-add the option "Reference frames only", but never answered to my post.
I think that now there is a lot of room in the GUI for adding this option.

Added the option back.

I also noted that once the field "Ref FrameDir" is set, there is not way to clear it (set it to null), could add this feature ?

Added a button to clear the setting.

Uploaded a new test version (Hybrid_deoldify; not dev version).

Le me know whether it works as you wanted.

Cu Selur

[Dan64]

I installed the dev version, but I don't see the option "Reference frames only" 



Could you check ?

Dan