Deoldify Vapoursynth filter

[Dan64]

Hi, Dan64
I think the result with the new version is excellent - it's clear that this software has unlimited possibilities
https://archive.org/details/crvena-zvezd...new-method

I also tried it on an old, worn-out Houdini film
https://archive.org/details/houdini-source
the result is quite good, except that it seems to emphasize the purple color much more than necessary - but overall it did a pretty good job and even corrected some of the bad scenes

thanks again for the excellent work

The Houdini clip is an example of movie that should not be selected for automatic colorizazition. The problem with this clip is that is damaged, and there is a lot of noise on the luma component. The colorization process is strongly dependent on the luminance. The reason of such strong dependency is that the model during the training sees only the L channel (lightness) as input. It has no access to the original colors, edges, textures, or semantics beyond what’s encoded in brightness. So it must infer color purely from luminance patterns:

•          Dark regions → might be shadows, blue sky, black hair, etc.
  
•          Medium gray → could be skin, concrete, foliage.
  
•          Bright regions → could be clouds, snow, white paper, or specular highlights.
  

But luminance alone is ambiguous. For example:

    A dark patch could be:

•          Blue jeans (dark due to dye)
  
•          A shadow on white fabric (dark due to lighting)
  
•          Black leather
  

    A medium-bright patch could be:

•         Yellow banana
  
•         Light brown wood
  
•         Pale skin
  

 The model resolves this ambiguity using learned statistical priors from ImageNet (e.g., “objects that look like this in L are usually green”). So a noise on the input L channel is poison for the model.
  Unfortunately are not available filters that are able to remove such kind of noise. In any case, if you still want to color such type of clip, you need to accept some compromise on the colorization process. With the upcoming release of HAVC 5.6.0, you should be able to obtain a clip like this one:  Houdini_BN_small_havc_coloradjust.mp4

   The upcoming HAVC release 5.6.0, has finally solved most of colorization problems, and now it is possible to obtain fully stable colored movies (if there is no noise on the luma).

   Here you can find an example of clip colored with the new version here:  children-of-the-damned-colorized-1964

Dan

[didris]

Hi, Dan64
what you have done is really amazing
your work can be safely used for coloring movies in Hollywood
if it is not a secret what is the code for the compromise coloring of the Houdini movie?
we are looking forward to the new version
and congratulations for the excellent work
thanks of course to Selur for his Hybrid
excellent work