This forum uses cookies
This forum makes use of cookies to store your login information if you are registered, and your last visit if you are not. Cookies are small text documents stored on your computer; the cookies set by this forum can only be used on this website and pose no security risk. Cookies on this forum also track the specific topics you have read and when you last read them. Please confirm whether you accept or reject these cookies being set.

A cookie will be stored in your browser regardless of choice to prevent you being asked this question again. You will be able to change your cookie settings at any time using the link in the footer.

Using Stable Diffision models for Colorization
#14
Hello,

  For those interested in applying DiT models to color old BW films, I've recolored the films I've published on the Internet Archive using the new Pipeline, which uses a DiT model to automatically color the reference frames. 
  The list is available at this link: havc-colorized-movies

  the new Pipeline for colorize the movies is the following:

    1) extract the reference frames (with HAVC)
    2) colorize the reference frames with a DiT model (currently I'm using qwen-image-edit) 
    3) propagate the color of reference frames to full clip  (with HAVC)
    4) generate an alternative stable colored clip  (with HAVC)  

 unfortunately even if the frames colored with DiT models have more stable and better colors than DDColor, the problem of color stability and consistency is still present. In order to mitigate it, I need to merge the clip colored at the step 3 with the clip generated at step 4.
   In my list of colored movies, there is only one movie that was not merged with an alternative stable colored clip: a-night-to-remember-colorized-1958-720p (*)

Dan

(*) left as a reference to the problems of stability and consistency of colors using DiT models. The movie was colored with HAVC(ColorMNet, max_memory_frames=150), despite its shortcomings, ColorMNet is the only model that is able to mitigate this problem automatically.
Reply


Messages In This Thread
RE: Using Stable Diffision models for Colorization - by Dan64 - 25.01.2026, 10:57

Forum Jump:


Users browsing this thread: 1 Guest(s)