Using Stable Diffision models for Colorization

[Dan64]

Try to set the windows user environment variable VSSCRIPT_PATH to

F:\AI_Works\DiTServerRPC\.venv\Lib\site-packages\vapoursynth\vsscript.dll

What script are you using to run the GUI ?
 
Dan

---

Hi, Dan

The installation was not easy, but I managed to get it working in the end. I think the problem was related to

tkinter_embed

in

requirements.txt

, which was causing issues in my environment. After removing it, everything installed correctly.

Overall, the software works now, and I successfully encoded five videos with durations of 10–15 minutes. Speed is 5 sec/frame with RTX5090. During testing, I noticed three issues:

1. It seems to work reliably only with MP4 and MKV files. I tested a MOV file, and it only started processing after I renamed it to MP4. Even then, it encoded only about 2 minutes and 30 seconds out of a 14-minute video.
   
2. The final output videos have no audio track.
   
3. In many videos, the reference frames were not colorized consistently, especially in the second half of the footage. In one particular video, almost none of the reference frames were colorized. I am not sure what this depends on or what type of source material works best. Perhaps a different Qwen model would help.
   
   

First all the GUI is very simple and is not a Hybrid replacement, it support only the colorization task, so if you need audio you need to mux it with mkvmerge.
To open the video stream I'm using LSmashSource I don't know the kind of support of MOV file, but if the problem is only this you can convert the MOV to MKV with mkvmerge.

Regarding the missing colorization, this is very strange.
Did you check the folder "ref_qwen" ? this folder contains the colored images, while the B&W images are stored in "ref_tht10", please check them.

Dan