2D Cleaners and Rescale!!

[Selur]

Okay,... I don't think any normal filter can clean this up properly.
That said using

# Imports
import vapoursynth as vs
core = vs.get_core()
# Loading Plugins
from vsgan import VSGAN

# Import scripts
import adjust

clip = core.lsmas.LibavSMASHSource(source="C:/Users/Selur/Desktop/Hora.de.Aventura-00.03.05.366-00.04.05.766.mp4")
# making sure input color matrix is set as 709
clip = core.resize.Point(clip, matrix_in_s="709",range_s="limited")
# making sure frame rate is set to 30
clip = core.std.AssumeFPS(clip=clip, fpsnum=30, fpsden=1)
# Setting color range to TV (limited) range.
clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1)

# needed since otherwise vsgan will crash on my GPU due to VRAM shortage
clip = core.fmtc.resample(clip=clip, kernel="spline16", w=720, h=406, interlaced=False, interlacedd=False)

# adjusting color space from YUV420P8 to RGB24 for vsLevels
clip = core.resize.Bicubic(clip=clip, format=vs.RGB24, matrix_in_s="709", range_s="limited")

# creating a VSGAN instance
vsgan = VSGAN("cuda")
# setting model
model = "J:/VapourSynth64Portable_VSGAN/vsgan_models/BSRGAN.pth"
vsgan.load_model(model)
# running vsgan with the selected model
clip = vsgan.run(clip=clip)

# convert to YUV420P10 for encoding
clip = core.resize.Bicubic(clip=clip, format=vs.YUV420P10, matrix_s="709", range_s="limited")

clip.set_output()

Produces really nice output:

Problem is:
a. BSRGAN increases width&height by a factor of 4 (so if you want a lower resolution additional resizing your be needed
b. I had to reduce the resolution to now run out of VRAM and at least on my Geforce GTX 1070ti, I get ~0.23fps for this (cpu isn't really used) Encoding the 1822 frames is estimated to take ~2hours.

There probably is a way to get this done without using BSRGAN (https://github.com/cszn/BSRGAN) or the way I use it through vsgan, my cleverly creating some mask and similar, but I don't know a simple filter I could add for Hybrid that would directly help with this.


Cu Selur