Deoldify Vapoursynth filter

[Selur]

@Dan64: could you create a new spartial_correlation_sampler build with Python 3.13 and cu130?

Cu Selur

[Dan64]

Torch version ?

[Selur]

torch 2.10.0+cu130
see: pip list

Cu Selur

[Dan64]

Hello Selur,

  I attached the zipped wheel.
  I cannot test it because I don't have already switched to python 3.13 and torch 2.10 with CUDA 13.0.
  Let me know if is working on your side.

Dan

[Selur]

Works!
Thanks!
One less hurdle.
(HolyWu's filter don't work with TRT+FP16 and dlib cuda version doesn't work)

Cu Selur

[Dan64]

Hello Selur,

  let me know if the attached dlib build is working on your side.

Dan

[Selur]

Thanks, but sadly not:

2026-02-15 14:24:46.364
Error on frame 0 request:

Traceback (most recent call last):
File "src/cython/vapoursynth.pyx", line 3222, in vapoursynth.publicFunction
File "src/cython/vapoursynth.pyx", line 3224, in vapoursynth.publicFunction
File "src/cython/vapoursynth.pyx", line 837, in vapoursynth.FuncData.__call__
File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\utils\_contextlib.py", line 124, in decorate_context
return func(*args, **kwargs)
File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\vscodeformer\__init__.py", line 122, in inference
face_helper[local_index].get_face_landmarks_5(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
only_center_face=only_center_face, resize=640, eye_dist_threshold=5
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\vscodeformer\face_restoration_helper.py", line 218, in get_face_landmarks_5
return self.get_face_landmarks_5_dlib(only_keep_largest)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\vscodeformer\face_restoration_helper.py", line 182, in get_face_landmarks_5_dlib
det_faces = self.face_detector(self.input_img, scale)
RuntimeError: Error while calling cudaOccupancyMaxPotentialBlockSize(&num_blocks,&num_threads,K) in file D:\PProjects\dlib\dlib\cuda\cuda_utils.h:164. code: 209, reason: no kernel image is available for execution on the device

Cu Selur

[Dan64]

Try the attached script and let me know.

Dan

P.S.

check also if the following paths are available on your side (file: dlib\__init__.py):

if 'ON' == 'ON':
    add_lib_to_dll_path('C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.0/lib/x64/cudnn.lib')
    add_lib_to_dll_path('C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.0/lib/x64/cudart.lib')

[Selur]

I placed the .dat into the 'Hybrid\64bit\Vapoursynth\Lib\site-packages\vscodeformer\models' folder and renamed it to 'mmod_human_face_detector-4cb19393.dat' to replace the existing one.
Tried Vapoursynth:

2026-02-15 16:02:50.773
Error on frame 0 request:

Traceback (most recent call last):
File "src/cython/vapoursynth.pyx", line 3222, in vapoursynth.publicFunction
File "src/cython/vapoursynth.pyx", line 3224, in vapoursynth.publicFunction
File "src/cython/vapoursynth.pyx", line 837, in vapoursynth.FuncData.__call__
File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\utils\_contextlib.py", line 124, in decorate_context
return func(*args, **kwargs)
File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\vscodeformer\__init__.py", line 122, in inference
face_helper[local_index].get_face_landmarks_5(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
only_center_face=only_center_face, resize=640, eye_dist_threshold=5
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\vscodeformer\face_restoration_helper.py", line 218, in get_face_landmarks_5
return self.get_face_landmarks_5_dlib(only_keep_largest)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\vscodeformer\face_restoration_helper.py", line 182, in get_face_landmarks_5_dlib
det_faces = self.face_detector(self.input_img, scale)
RuntimeError: Error while calling cudaOccupancyMaxPotentialBlockSize(&num_blocks,&num_threads,K) in file D:\PProjects\dlib\dlib\cuda\cuda_utils.h:164. code: 209, reason: no kernel image is available for execution on the device

then i tried:

F:\Hybrid\64bit\Vapoursynth>python test_dlib_cuda_13.py
Traceback (most recent call last):
  File "F:\Hybrid\64bit\Vapoursynth\test_dlib_cuda_13.py", line 1, in <module>
    import dlib
  File "F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\dlib\__init__.py", line 28, in <module>
    from _dlib_pybind11 import *
ImportError: DLL load failed while importing _dlib_pybind11: Das angegebene Modul wurde nicht gefunden.

Cu Selur