Using Stable Diffision models for Colorization

[hallomanbh]

One suggestion that I think could significantly improve frame-to-frame color consistency is to allow manual color specification for different objects within a shot.
For example, if I specify:

• Top/Shirt: Light Blue
  
• Bottom/Pants: Dark Brown
  
• Background: Light Green
  

then the model should consistently follow these colors throughout the entire shot.
If I notice that the color changes in a particular frame, I should be able to simply update the color (for example, change the shirt to Light Blue), and the model should automatically apply that corrected color consistently to the corresponding object across all frames in that shot.
This would give users an easy way to maintain temporal consistency while still allowing quick manual corrections whenever needed, without having to fix each frame individually.