Selur's Little Message Board
How can deblend this ? - Printable Version

+- Selur's Little Message Board (https://forum.selur.net)
+-- Forum: Talk, Talk, Talk (https://forum.selur.net/forum-5.html)
+--- Forum: Small Talk (https://forum.selur.net/forum-7.html)
+--- Thread: How can deblend this ? (/thread-4375.html)

Pages: 1 2 3 4

RE: How can deblend this ? - powerthrash4K - 25.04.2026

Thank you very much. I'll try this!
Where can I find the edgemask?
I tried this for Naruto, added SMDegrain and Darken with 4,0, but got a crashed error. See the DebugOutput File.

RE: How can deblend this ? - lastchance22 - 26.04.2026

You need to install the VapourSynth add-on from this address: https://www.selur.de/downloads
And you’ll find the “edgemask” on the right side of your filter—you need to scroll to the right.

RE: How can deblend this ? - Selur - 26.04.2026

Masking controls are independent of the add-ons, they just have to be enabled,...
That crash has nothing do to with edge masking,... (side note: Note that I, in my example, adjusted the filter order)
=> Check the Vapoursynth Preview to see what the problem is.

RE: How can deblend this ? - lastchance22 - 26.04.2026

Hey Selur,

I’m working on an anime DVD (1999 source) that has strong chroma artifacts on edges (red/green flickering / rainbowing, especially along line art).

I’ve managed to attenuate the issue quite a bit using VapourSynth (mainly Decross + chroma denoise + some temporal filtering), and the result is definitely improved.

However, I still can’t fully remove the problem — in some scenes the red/green flickering on edges is still visible, especially during motion or on high-contrast outlines.

It seems to be a mix of cross-color and chroma instability from the source, but I’m not sure what the best next step would be.

Is there a better approach for stubborn chroma flickering on DVD anime sources?

Thanks a lot for any help 👍

RE: How can deblend this ? - Selur - 26.04.2026

Would need an 'as untouched as possible' sample of the source to say for sure to really see what is happening.
Chroma artifacts can occur due to improper deinterlacing / ivtc /...
Depending on the nature of the artifacts, filtering might be best applied to the separate fields of the source.
Sometimes only, machine learning stuff (or really arcane scripting) can help.
Without a sample, for chroma issues I would recommend:
a. try the derainbow filters with different settings
b. try denoise filters with high thresholds on chroma only
c. depending on the anime / cartoon someone might have already posted a model over at https://openmodeldb.info/ that was trained for that or similar content that might help.
d. depending on the nature of the artifacts there might be a chroma shift or chroma bleeding,...

=> share one or multiple short samples ('as untouched as possible') with me and I might be able to suggest something.

Cu Selur

Ps.: sometimes stuff is just too broken to get 'properly' fixed,...

RE: How can deblend this ? - lastchance22 - 27.04.2026

Hi Selur,
I’m dealing with a low-quality DVD source, and I’ve run into a couple of issues during encoding that I’m not sure how to properly address.
One problem is a sort of rainbow-like shimmering / color fringing, especially around edges and fine lines. It becomes quite noticeable in motion, where the colors seem to flicker slightly.
Another issue is that very close line details tend to “merge” together. Instead of seeing distinct lines, they often get compressed into a single blocky shape, likely due to the limited resolution and chroma subsampling of the source.
I’m trying to improve the overall clarity without overly blurring the image. Are there any recommended filters or workflows to better preserve (or recover) fine line detail in this kind of situation?
Also, I was wondering if there are any AI / machine learning-based tools that could help reconstruct or refine line art — for example, separating merged lines or improving edge definition.
Any advice or suggestions would be greatly appreciated. Thanks in advance!

   
http://titant.free.fr/tmp/A1_t00.mkv

PS: I’ve managed to significantly reduce the issue, mainly thanks to Decross, but it still persists in certain scenes.

RE: How can deblend this ? - Selur - 27.04.2026

for combing handling, I would:
  • 'overwrite input scan type to' 'telecine'
  • under "TIVTC Settings->TFm->Basic->Deinterlacer" select 'QTGMC(preset="fast")' and enable GPU
Sadly simply applying BasicVSR++ to the whole frame is too aggressive:
[Image: grafik.png]
especially notice the edges of the grass.
To lessen the aggresiveness of BasicVSR++, I would move it behind the resize (and resize to a higher resolution) and then apply it masked with EdgeMask (Prewitt), Expand 1, binarize 0,2.
This seems to fix the rainbows and dot craw just fine.
To ideally mask this, one would have to create some custom mask, but I don't know a good way to add this to a gui, that is not really an option. Smile
Here's a suggestion for the clip, where I added DPIR for general denoising: https://pastebin.com/5n9yaM3s

Cu Selur

RE: How can deblend this ? - Selur - 27.04.2026

Here's another (way faster) approach: https://pastebin.com/JuNAghXd
also try:
  • 'overwrite input scan type to' 'telecine'
  • under "TIVTC Settings->TFm->Basic->Deinterlacer" select 'QTGMC(preset="fast")' and enable GPU
  • Rainbow
  • Resizer->RealESRGAN with realesr-anime

Cu Selur

ps.: 1x_Dotzilla_Compact_80k_net_g.onnx also works
.

RE: How can deblend this ? - Selur - 27.04.2026

Hie,
  • 'overwrite input scan type to' 'top field first'
  • under "TIVTC Settings->TFm->Basic->Deinterlacer" select 'QTGMC(preset="fast")' and enable GPU
  • 1x_Dotzilla_Compact_80k_net_g.onnx
  • MCTemporalDenoise with using Settings 'very low'
so far is the fastest method so far and does seem fine to me. Smile
Script, Clip
If you want it sharper, add a sharpener.

Cu Selur

RE: How can deblend this ? - lastchance22 - 01.05.2026

WOW, this is amazing—it's exactly what I need. Where can I find "1x_Dotzilla_Compact_80k_net_g.onnx" in Hybrid?
Did you only add that, or should I also keep “Decrawl,” “Santiag,” and everything else enabled?

PS I downloaded **vsmlrt-windows-x64-cuda.v15.16.7z** and **1x_Dotzilla_Compact_80k_net_g.onnx**. Where should I extract them in Hybrid?