Deoldify Vapoursynth filter

[Selur]

What I did with the latest version

cd F:\Hybrid\64bit\Vapoursynth git clone https://github.com/dan64/DiTServerRPC.git DiTServerRPC-main cd DiTServerRPC-main ..\python -m pip install virtualenv ..\python -m virtualenv .venv .venv\Scripts\activate pip install torch==2.9.1+cu128 torchvision==0.24.1+cu128 torchaudio==2.9.1+cu128 --index-url https://download.pytorch.org/whl/cu128 pip install https://github.com/nunchaku-ai/nunchaku/releases/download/v1.2.1/nunchaku-1.2.1+cu12.8torch2.9-cp312-cp312-win_amd64.whl pip show nunchaku python patch_nunchaku.py python patch_nunchaku.py --check pip install packages\diffusers-0.37.0.dev0-py3-none-any.whl python -c "import diffusers; print(diffusers.__version__)" pip install transformers==4.57.6 accelerate==1.12.0 huggingface_hub>=0.26.0 Pillow>=10.0.0 python dit_rpc_server.py --load-pipeline --pipeline-config qwen_config_int4.json

then I used:

clip = havc.HAVC_cmnet2dit(clip, encode_mode=1, dit_engine_params={"host": "127.0.0.1", "port": 8765, "model_precision": "int4"})

in Hybrid, but that crashed while using:

"F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\vapoursynth\vspipe.exe" "J:\tmp\2026-05-24@18_25_46_1110\encodingTempSynthSkript_2026-05-24@18_25_46_1110_0.vpy" - --outputindex 0 -c y4m |"F:\Hybrid\64bit\NVEncC.exe" --y4m -i - --fps 25.000 --codec av1 --sar 1:1 --lookahead 32 --output-depth 10 --vbr 0 --vbr-quality 23.00 --aq --aq-strength 5 --aq-temporal --gop-len 0 --ref 6 --multiref-l0 3 --multiref-l1 3 --bframes 3 --direct auto --bref-mode auto --no-b-adapt --mv-precision Q-pel --preset quality --colorrange limited --colormatrix smpte170m --colorrange limited --cuda-schedule sync --output "J:\tmp\2026-05-24@18_25_46_1110\test_1_2026-05-24@18_25_46_1110_02.av1"

Server showed:

100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:03<00:00, 1.86s/it] 2026-05-24 18:26:35,387 [INFO] colorize_frame_pair_shm: 10.26s (5.13s/frame) 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:03<00:00, 1.69s/it] 2026-05-24 18:26:48,751 [INFO] colorize_frame_pair_shm: 9.41s (4.70s/frame) 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:03<00:00, 1.69s/it] 2026-05-24 18:26:56,753 [INFO] colorize_frame_pair_shm: 7.83s (3.91s/frame) 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:03<00:00, 1.69s/it] 2026-05-24 18:27:04,797 [INFO] colorize_frame_pair_shm: 7.87s (3.93s/frame) 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:03<00:00, 1.76s/it] 2026-05-24 18:27:12,892 [INFO] colorize_frame_pair_shm: 7.92s (3.96s/frame) 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:03<00:00, 1.69s/it] 2026-05-24 18:27:20,794 [INFO] colorize_frame_pair_shm: 7.74s (3.87s/frame) ---------------------------------------- ---------------------------------------- Exception occurred during processing of request from ('127.0.0.1', 10668) Exception occurred during processing of request from ('127.0.0.1', 10669) Traceback (most recent call last): Traceback (most recent call last): File "socketserver.py", line 697, in process_request_thread File "socketserver.py", line 697, in process_request_thread File "socketserver.py", line 362, in finish_request File "socketserver.py", line 766, in __init__ File "socketserver.py", line 362, in finish_request File "http\server.py", line 438, in handle File "socketserver.py", line 766, in __init__ File "http\server.py", line 404, in handle_one_request File "http\server.py", line 438, in handle File "socket.py", line 720, in readinto File "http\server.py", line 404, in handle_one_request File "socket.py", line 720, in readinto ConnectionResetError: [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen

So I tried it manually with the above call and got:

C:\Users\Selur>"F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\vapoursynth\vspipe.exe" "J:\tmp\2026-05-24@18_25_46_1110\encodingTempSynthSkript_2026-05-24@18_25_46_1110_0.vpy" - --outputindex 0 -c y4m |"F:\Hybrid\64bit\NVEncC.exe" --y4m -i - --fps 25.000 --codec av1 --sar 1:1 --lookahead 32 --output-depth 10 --vbr 0 --vbr-quality 23.00 --aq --aq-strength 5 --aq-temporal --gop-len 0 --ref 6 --multiref-l0 3 --multiref-l1 3 --bframes 3 --direct auto --bref-mode auto --no-b-adapt --mv-precision Q-pel --preset quality --colorrange limited --colormatrix smpte170m --colorrange limited --cuda-schedule sync --output "J:\tmp\2026-05-24@18_25_46_1110\test_1_2026-05-24@18_25_46_1110_02.av1" -------------------------------------------------------------------------------- J:\tmp\2026-05-24@18_25_46_1110\test_1_2026-05-24@18_25_46_1110_02.av1 -------------------------------------------------------------------------------- Warning: Plugin F:\Hybrid\64bit\vsfilters\ColorFilter\Retinex\Retinex.dll is using API3 which is deprecated and will be removed shortly. Warning: Plugin F:\Hybrid\64bit\vsfilters\Support\akarin.dll is using API3 which is deprecated and will be removed shortly. Error: Failed to retrieve frame 0 with error: Traceback (most recent call last): File "vapoursynth.pyx", line 3353, in vapoursynth.publicFunction File "vapoursynth.pyx", line 3355, in vapoursynth.publicFunction File "vapoursynth.pyx", line 818, in vapoursynth.FuncData.__call__ TypeError: _colormnet2dit_async.<locals>.colormnet_dit_color() got an unexpected keyword argument 'reader' Output 32 frames in 0.09 seconds (338.41 fps) NVEncC (x64) 9.16 (r3587) by rigaya, May 1 2026 01:35:16 (VC 1944/Win) OS Version Windows 11 x64 (26200) [UTF-8] CPU AMD Ryzen 9 7950X 16-Core Processor [5.51GHz] (16C/32T) GPU #0: NVIDIA GeForce RTX 4080 (9728 cores, 2505 MHz)[PCIe4x16][596.36] NVENC / CUDA NVENC API 13.0, CUDA 13.2, schedule mode: sync Input Buffers CUDA, 44 frames Input Info y4m(yv12(10bit))->p010 [AVX2], 640x352, 25/1 fps Vpp Filters copyDtoD Output Info AV1 main 10bit @ Level auto 640x352p 1:1 25.000fps (25/1fps) Encoder Preset quality Rate Control VBR Multipass none Bitrate 0 kbps (Max: 2000 kbps) Target Quality 23.00 QP range I:0-255 P:0-255 B:0-255 QP Offset cb:0 cr:0 VBV buf size auto Split Enc Mode auto Tuning Info hq Lookahead on, 32 frames, Adaptive I Insert GOP length 250 frames B frames 3 frames [ref mode: middle] Ref frames 6 frames, MultiRef L0:auto L1:auto AQ on (spatial, temporal, strength 5) Part size max auto / min auto Tile num columns auto / rows auto TemporalLayers max 1 Refs forward auto, backward auto VUI matrix:smpte170m,range:limited Others mv:Q-pel encoded 0 frames, 0.00 fps, 0.00 kbps, 0.00 MB encode time 0:00:00, CPULoad: 1.9%