This noise is on the side quarters of the frame, and usually is seen on blue skies and solid backgrounds. I use Mercalli and it's an artifact of the defisher function and an ActionCam.
Currently, I use 4 filtering settings together to get a pretty good removal.
in Vapoursynth:
MLDegrain, default
TemporalDegrain2: with nStep, subpixel at soft, and a 3 radius,
FluxSmooth, Spatio on,
FrFun7, default
I haven't tried Avisynth, or no xSynth.
I tried nearly every combination of settings that worked, but now the performance is very slow like 0.5 FPS, when it's usually 5.
Is there a setting that can be a stand alone filter, for this problem, and sped up?
Current: Hybrid 2024.06.16.1
Would need a sample clip of the source to suggest settings.
Got the sample.
The whole thing doesn't look like 4k at all,...
Is that your source? That looks like a bad reencode. (way too high compressed for intermediate content)
Cu Selur
Ps.: okay, that file was created with Hybrid so it's not the source and thus useless,... => I need a snippet of the source not some reencode to suggest any meaningful filtering.
What happens is, the output of Mercalli is a variable frame rate. I have to force a constant frame rate through Hybrid, because all my edit programs can't work with VFR. My constant rate factor was set to 25 on 4K, and the intermediate output is H.264.
I did compress because I have a 14K connection.
I'll try again with the 300MB intermediate, but will take 5 hours, and hope it doesn't fail.
Fingers crossed.
Intermediates should be lossless, but sharing whatever you feed Hybrid is the right thing.
(Depending on what Mercalli does, maybe filter before processing it with Mercalli.)
Cu Selur
https://drive.google.com/file/d/1iiE_x6A...sp=sharing
I made a 5 second snippet. This is the worst spot, but every clip does this on defishing.
***The whole thing doesn't look like 4k at all,... ***
Mercalli does zoom in to compensate for stabilizing and defishing to hide the edge, and the ActionCam has an M12 8MP, 127° Wide Angle Lens(89°@4K,actual), Dia: 17.48mm, which is fairly standard for 2018. The element is 0.25", so I'm never going to get a good sharp 4K shot of high end models. The color is better than a GoPro Hero3 of the same design, but it's not bad for a $35 4K camera. I can't afford a $+1K camera, so I'm making due with what I can. I don't like how they cheated making 22fps into a fake 30fps VFR, so I'm grateful to you that I can make it 24fps CFR. It screwed up everything, and Hybrid saved a lot of work.
Quote:Mercalli does zoom in to compensate for stabilizing and defishing to hide the edge
If possible you might want to configure it to just crop and not upscale, since the upscaling complicates the filtering. (+ like I wrote intermediates should be lossless, this file is CRF 28
)
What gpu do you have? (to know whether using any machine learning filters could make sense)
Given the crappy (crf 28) source.
You will definitely lose some more 'details' since, even when looking at that manually, I often can't really tell what's artifact and what detail.
If possible, you might want to use 10bit encoding as intermediate to avoid some of the banding.
About filtering this mess:
a. try to find a mask i.e. LumaMask with Limit 100 (or higher) with which you can limit what you want to get filtered
b. then try some strong masked denoising
c. maybe downscale to 1080p and apply all filtering after that.
Cu Selur
Ps.: if machine learning is an option, downscaling to 1080p and applying SCUNet might be an option, to get it somewhat better, i.e.
https://www.mediafire.com/file/ygh6h9wpy...y.mp4/file
My pipeline is the following:
Hybrid, from Raw, to adjust the 22fps VFR, into 23.976 fps CFR. This corrects for the frame skipping and the 15-30fps VFR issue before entering Mercalli.
Mercalli 6.0, partitions the original length, defishes the frame, and repositions each frame. If it didn't zoom in, it would cause the border to be exposed at 100%, because of the shaking and Rock Steady smooth out, so all frames are fitted to size, position, angle, etc., to make it look nice, without reflections or black borders. Simple cropping doesn't work. It also adjusts color, panning, tilting, sharpening, enhancement, etc. (I wish it could dehaze.) The output is VFR. I use medium quality output, unless it's poor quality. I told ProDAD to let us chose the outputs to CFR/VFR, but settings are rather limited.
Then Hybrid, to denoise, degrain, speed change, and convert to CFR, clean out the VFR, because Vegas, Mercalli (double run-through), etc. will skip frames on VF, I have found. Convert to H.265, and set constant rate factor to better than recommended number. Sound is usually off, unless required.
*****
I also use HandBreak for deinterlacing SD,
(but I just tried Hybrid, and found it better, but the Bob is not working to double frame rates, and I have to increase to 60, to get 30fps. it's not automatically set correctly.)
I like the prefix suffix settings in HB, they are quite versatile and convenient.
I also use Shutter Encoder for HD on up. It's very fast and uses the GPU, but is neat that I can convert alongside Hybrid, without much performance drop im either. They just included better prefix/suffex settings, but is buggy. Max Conversion rate is about 20-25fps.
Hybrid is best in serious problems, and the steepest learning curve by far. We really need to know what we are doing, and would be better if the GPU was used. Max Conversion rate is about 5-6fps.The presettings are not obvious to figure out, and can't figure out what it sets, and where.
I have the N100, and the Intel Graphics HD 620 or so, and does about 300 GFLOPS, with 24 CU. This Gen just added some AI features, but just rudimentary ones.