Using Stable Diffision models for Colorization

[Selur]

vshavc-5.8.5_RC8 + "python dit_rpc_server.py --load-pipeline --pipeline-config config/qwen_gguf_q3.json" seems to work fine.
I like the addtional output in the server window, since it lets you know that something is done and not stuck.

As a suggestion: Maybe add a debug_show_reference or something similar to HAVC_cmnet2dit so one can see which frames would be chosen to create colored references for. Atm. tweaking sc threshold and sc SSIM threshold seems like a pain. Maybe also add an option to overwrite which frames should be colorized.

Cu Selur

[Dan64]

Hi Selur,

  unless I lost your message, it is missing a Hybrid dev version with the support of vshavc-5.8.5.

Dan

[Selur]

Normal dev should work. Here I used the latest dev, which I had adjusted to vshavc and then extracted vshavc-5.8.5_RC8 into the site-packages folder,..

Cu Selur

[Dan64]

vshavc-5.8.5_RC8 + "python dit_rpc_server.py --load-pipeline --pipeline-config config/qwen_gguf_q3.json" seems to work fine.
I like the addtional output in the server window, since it lets you know that something is done and not stuck.

As a suggestion: Maybe add a debug_show_reference or something similar to HAVC_cmnet2dit so one can see which frames would be chosen to create colored references for. Atm. tweaking sc threshold and sc SSIM threshold seems like a pain. Maybe also add an option to overwrite which frames should be colorized.

Cu Selur

Normal dev should work. Here I used the latest dev, which I had adjusted to vshavc and then extracted  vshavc-5.8.5_RC8 into the site-packages folder,..

Cu Selur

I tested Hybrid 2026.05.30.1 with VS R76, but unfortunately your patch to use

core.num_threads=1

does not work. It tested it on a clip of 2544 frames and the encoding frozen after encoding 768 frames.

I copied  Hybrid 2026.05.30.1 in my R74, and it worked. 
I attached the encoding reports obtained using fp4 and q3 quantizations on server side.

Please do no deliver Hybrid with R76 till this issue will be solved.

I should be necessary open an issue on Vapoursynth site, but it would be necessary to write a simpler script that reproduce the issue because HAVC is complex.

Dan
P.S. I released HAVC 5.8.5 in the case VS people want to test the HAVC script

[Selur]

Please do no deliver Hybrid with R76 till this issue will be solved.

Next Hybrid release, like the dev version will be R76.

It tested it on a clip of 2544 frames and the encoding frozen after encoding 768 frames.

Okay, I will keep CMNet2DiT disabled till it works with R76.
Hmm,.. According to the report all frames were encoded. So, if the encoder got all the images, but the output freezes after a while it seems like the server delivered the same frame over and over again,...

I should be necessary open an issue on Vapoursynth site, but it would be necessary to write a simpler script that reproduce the issue because HAVC is complex.

simple script:

import vapoursynth as vs core = vs.core clip = core.bs.VideoSource(source="PATH TO SOURCE") import vshavc as havc clip = havc.HAVC_cmnet2dit(clip, dit_engine_params={"host": "127.0.0.1", "port": 8765, "model_precision": "int4"}) clip.set_output()

fingers crossed that myrsloik is in a good mood and willing to help.



Cu Selur

[Dan64]

I will open the issue, but should be clear that is bug introduced with R76, all previous VS version works (not tested R75).
Not clear to me why you want to use R76 despite this bug. 
What are the significant improvements introduced in R76 respect to R74 ?

Dan

P.S.
The reports provided were obtained with R74 (that works !)

[Selur]

Form my perspective, the main improvements from R74 to R76 are:

• plugins can now ship with multiple copies targeting different optimization levels on x64 and have the best one automatically loaded
  
• more consistent integration with pip
  

R76 should have 'better' cache handling.

Cu Selur

Ps.: updated Hybrid_havc_test, updated dev to disable CMNet2DiT and uploading new torch with HAVC 5.8.5. (will be up in ~ 1 1/2 houra)

[Dan64]

The main change introduced in HAVC 5.8.5, is CMNet2DiT if you disable it, you can stay on HAVC 5.8.1

As compromise solution on dev folder you can keep in parallel 2 VS versions R76 and R74 (with just HAVC upgrade to 5.8.5) so that the users willing to use CMNet2DiT can install R74 while the other users can install R76.

Dan

P.S.
I opened the issue: #1214

[Selur]

I would prefer not having to maintain two Vapoursynth torch-add-on versions, but I'll think about it depending on how myrsloik will react in the next days.

Cu Selur

[Selur]

btw. did you try using get_frame_async instead of get_frame ?