This forum uses cookies
This forum makes use of cookies to store your login information if you are registered, and your last visit if you are not. Cookies are small text documents stored on your computer; the cookies set by this forum can only be used on this website and pose no security risk. Cookies on this forum also track the specific topics you have read and when you last read them. Please confirm whether you accept or reject these cookies being set.

A cookie will be stored in your browser regardless of choice to prevent you being asked this question again. You will be able to change your cookie settings at any time using the link in the footer.

Using Stable Diffision models for Colorization
Hi safshe, 

    LTX 2.3 has  native limitations:
 
  1.  Maximum duration per single clip: The model natively generates segments up to 20 seconds per pass 
  2.  Temporal coherence limitations: Generating 10 continuous minutes or more would require a large amount of video memory (VRAM) and temporal context stability that the current architecture of Diffusion Transformers (DiT) cannot handle without completely losing the thread of the plot, physics, and characters after a few dozen seconds.

   So I don't think that LTX is currently a viable solution for the coloring movies with consistent colorization. 
   Indeed I think that HAVCServerDiT is a practical working solution

   I made a test with a 90min clip. I generated about 3500 reference images, to introduce color consistency I removed the inconsistent frames and changed the colors of the necessary frames with "Fix Image" and/or "Fix Colors". In about 4h I was able to obtain all the necessary reference frames with the correct colors. Previously the video colorization was an activity that required several months of manual colorization activity. Non you can obtain about the same quality in 8h (4h for fix reference frames + 4h for encoding).
  I think that is a significant improvement.

Dan
Reply


Forum Jump:


Users browsing this thread: 2 Guest(s)