Using Stable Diffision models for Colorization

[Selur]

Plugins I install through pip (python -m pip install -U -r plugins.txt):

vapoursynth vapoursynth-adaptivegrain vapoursynth-akarin vapoursynth-awarp vapoursynth-bestsource vapoursynth-bilateralgpu vapoursynth-bm3d vapoursynth-bwdif vapoursynth-cranexpr vapoursynth-d2vsource vapoursynth-dctfilter vapoursynth-deblock vapoursynth-dedot vapoursynth-descale vapoursynth-descratch vapoursynth-dghdrtosdr vapoursynth-dotkill vapoursynth-edgefixer vapoursynth-edgemasks vapoursynth-eedi3 vapoursynth-fillborders vapoursynth-fmtconv vapoursynth-hysteresis vapoursynth-iscombed vapoursynth-knlmeanscl vapoursynth-mvtools vapoursynth-nlm-cuda vapoursynth-nlm-ispc vapoursynth-resize2 vapoursynth-sangnom vapoursynth-scenechange vapoursynth-sneedif vapoursynth-subtext vapoursynth-timecube vapoursynth-vivtc vapoursynth-vszip vapoursynth-wnnm vapoursynth-zit vapoursynth-znedi3 vapoursynth-zsmooth vs-placebo vsnoise

and move them (from "Vapoursynth\Lib\site-packages\vapoursynth\plugins") into "Vapoursynth\Lib\site-packages\vapoursynth\plugins2" to avoid automatic loading.
here's the content of the plugins2 folder:

Vapoursynth\Lib\site-packages\vapoursynth\plugins2>ls -R .: DGHDRtoSDR.dll bilateralgpu deblock.dll eedi3m.dll libdescale.dll sneedif vszip KNLMeansCL.dll bm3d.dll dedot.dll fillborders.dll libvs_placebo.dll subtext.dll wnnm.dll adaptivegrain bwdif.dll descratch.dll fmtconv.dll mvtools.dll timecube.dll zit.dll addnoise.dll cranexpr dotkill.dll hysteresis nnedi3_weights.bin vivtc.dll znedi3.dll akarin d2vsource.dll edgefixer.dll iscombed.dll resize2.dll vsnlm_cuda.dll zsmooth awarp.dll dctfilter.dll edgemasks.dll libbestsource.dll sangnom.dll vsnlm_ispc.dll '.\adaptivegrain': adaptivegrain_rs.avx2.dll adaptivegrain_rs.dll adaptivegrain_rs.zn4.dll manifest.vs '.\akarin': libakarin.dll libzstd.dll '.\bilateralgpu': bilateralgpu.dll bilateralgpu_rtc.dll '.\cranexpr': cranexpr.avx2.dll cranexpr.dll cranexpr.zn4.dll manifest.vs '.\hysteresis': hysteresis.dll hysteresis.v2.dll hysteresis.v3.dll manifest.vs '.\sneedif': libsneedif.dll nnedi3_weights.bin '.\vszip': manifest.vs vszip.avx2.dll vszip.dll vszip.zn4.dll '.\zsmooth': manifest.vs zsmooth.avx2.dll zsmooth.dll zsmooth.zn4.dll

Do you know it ?, do you think that can be a good replacement for SCDetect ?

Works fine here. (is used by Hybrid, vsscripts are adjusted for it)
I always call misc.SCDetect, which uses a plugin if it's available and falls back to a manual scene change detection otherwise.

Another final question: I noted that the only plugin to reading clip/movies installed via pip is vapoursynth-bestsource, do you know if there are other APIv4 plugins that can be used in substitution of bestsource (still too slow on big movies) ?

DGDecNV depending on the source. Aside from BestSource all the other libav based source filters are still APIv3 since nobody cared enough to update them to APIv4.


Cu Selur