Using Stable Diffision models for Colorization

[didris]

Hi Dan,

Thanks for the quick update!

There is just one issue. In the Fix Colors tab, under Target Image (B&W), it is still not possible to add multiple frames at once. They have to be selected one by one, which makes the workflow much slower. I hope this can be improved, because selecting each frame individually becomes quite tedious when working with many images.

For most videos, CMNET2 propagates the colors very well. However, there are also videos where it doesn't perform as consistently. If the same object has two or three different colors across different reference frames, it often either blends those colors together or, even worse, fails to propagate them correctly. I've attached two examples in case you're interested.

One question: do you think a Manual Edit tab would be technically feasible with the current pipeline? I mean something where the user could paint a mask over a small area (for example, a country flag) and recolor only that region while leaving the rest of the image untouched. Or would that require major changes to the DiT pipeline?

Thanks again for all your work!

https://www.swisstransfer.com/d/f313218b-1aa4-4232-b065-329fc4a38138