Deoldify Vapoursynth filter

[Dan64]

I tested the winner of NTIRE 2023 Video Colorization Challenge  (code here: Bistnet )

Unfortunately the results were not good as expected.

The approach followed by this model is to use some reference frame to map the objects color and then try to keep the temporal consistency.

Here a simple comparison

1) Start frame (for Bistnet is an external reference image)



In this case was used as reference the true starting frame, while DDeoldify had to guess, the colors.

2) Frame 25



in this case (due to temporal consistency) the boy's pants on the right start to turn red (like the girl's skirt)

3) Frame 80



in this case the boy's pants on the left start to turn red (like the girl's skirt)

4) Frame 125



in this case the girl's skirt starts to turn green (like the girl's pants)

In summary is not so good, DDelodifi(Stable) colors are less rich but are more stable.

Moreover is very slow: only 0.15 fps

Dan