27.02.2024, 18:20
Hello Selur,
I just completed the development of a Vapoursynth filter for Deoldify.
As you probably already know, Deoldify is a Deep Learning based project for colorizing and restoring old images and video.
Currently it is possible to use Deoldify using Jupyter or Stable Diffusion.
Now with this implementation it will be possible to use it directly in Vapoursynth.
To use this filter it is necessary to install fastai version v1.0.60 with the command
Deoldify is delivered with a own version of fastai, so this installation is necessary to install "only" the dependencies.
After the installation of fastai it is necessary to delete it from "Hybrid\64bit\Vapoursynth\Lib\site-packages" to avoid conflicts with the Deodify version (it seems that this problem arise only when Deoldify is inside a packeage).
To install the filter it is necessary to unzip the attached file vsdeoldify-1.0.0.zip in "Hybrid\64bit\Vapoursynth\Lib\site-packages"
I don't have included the models. They must downloaded from: https://github.com/jantic/DeOldify
And installed in the folder: "Hybrid\64bit\Vapoursynth\Lib\site-packages\vsdeoldify\models"
For your convenience I report here the links
ColorizeArtistic_gen.pth
ColorizeStable_gen.pth
ColorizeVideo_gen.pth
I attached also the file Example.zip with a simple example.
The usage is the following:
This is a draft version. It would be nice if you can install on your side to check if is working on your installation.
Thanks,
Dan
I just completed the development of a Vapoursynth filter for Deoldify.
As you probably already know, Deoldify is a Deep Learning based project for colorizing and restoring old images and video.
Currently it is possible to use Deoldify using Jupyter or Stable Diffusion.
Now with this implementation it will be possible to use it directly in Vapoursynth.
To use this filter it is necessary to install fastai version v1.0.60 with the command
python -m pip fastai=1.0.60
Deoldify is delivered with a own version of fastai, so this installation is necessary to install "only" the dependencies.
After the installation of fastai it is necessary to delete it from "Hybrid\64bit\Vapoursynth\Lib\site-packages" to avoid conflicts with the Deodify version (it seems that this problem arise only when Deoldify is inside a packeage).
To install the filter it is necessary to unzip the attached file vsdeoldify-1.0.0.zip in "Hybrid\64bit\Vapoursynth\Lib\site-packages"
I don't have included the models. They must downloaded from: https://github.com/jantic/DeOldify
And installed in the folder: "Hybrid\64bit\Vapoursynth\Lib\site-packages\vsdeoldify\models"
For your convenience I report here the links
ColorizeArtistic_gen.pth
ColorizeStable_gen.pth
ColorizeVideo_gen.pth
I attached also the file Example.zip with a simple example.
The usage is the following:
from vsdeoldify import ddeoldify
clip=ddeoldify(clip, model, render_factor, device_index, post_process)
where
- clip: Clip to process. Only RGB24 format is supported.
- model: Model to use (default 0).
0 = ColorizeVideo_gen
1 = ColorizeStable_gen
2 = ColorizeArtistic_gen
- render_factor: render factor for the model.
- device_index: Device ordinal of the GPU, choices: GPU0...GPU7, CPU=99 (default 0)
- post_process: post_process takes advantage of the fact that human eyes are much less sensitive to imperfections in chrominance compared to luminance lowering the memory usage (default True)
This is a draft version. It would be nice if you can install on your side to check if is working on your installation.

Thanks,
Dan