Deoldify Vapoursynth filter

[Dan64]

vsdeoldify-4.5.0_RC1

Hello Selur,

  I managed to get ColorMNet  inside Hybrid.
  These are the steps to install the v4.5.0 RC1:

  1) unzip the file spatial_correlation_sampler-0.5.0-py312-cp312-win_amd64.whl.zip under "Hybrid\64bit\Vapoursynth\Lib\site-packages"
  2) unzip the file vsdeoldify-4.5.0_RC1.zip under "Hybrid\64bit\Vapoursynth\Lib\site-packages"  (override the folder "vsdeoldify")   
  3) download the file DINOv2FeatureV6_LocalAtten_s2_154000.pth and save it in "Hybrid\64bit\Vapoursynth\Lib\site-packages\vsdeoldify\colormnet\weights"

At the first run will be downloaded additional files in:  "Hybrid\64bit\Vapoursynth\Lib\site-packages\vsdeoldify\models"

I added the following 2 fields to the function HAVC_deepx() :

• ex_model:  Exemplar model to use for the color propagation, available models are:
  

                    0 : ColorMNet
                    1 : Deep-Exemplar

• max_memory_frames:  Parameter used by ColorMNet model, specify the max number of encoded frames to keep in memory,
  

                    suggested values are :
                        4 or 5 : for 8GB GPU
                        8 or 9 : for 12GB GPU
                        15 or 16: for 24GB GPU
                    if set equal to 0 (zero) all the encoded video frames are stored in memory

Few changes are required in the GUI:

1) the frame "DeepEX" should be renamed in "Exemplar Models"
2) should be provide the option to select one of the 2 Exemplar Models available: ColorMNet, Deep-Exemplar
3) The following parameters are specific for a given Exemplar Model:
     render_vivid, render_speed: are used only by Deep-Exemplar
     max_memory_frames: is used only by ColorMNet

I hope that it will work also on your side.

crossing the finger...

Dan
      


ex