ProPainter Vapoursynth filter

[Selur]

Then I must have messed up the naming.

also the version of vsdeoldify is 3.5.3 and not 4.0.0.
and the version of vsrealesrgan is 4.1.0 and not 5.0.0

yes, those are older versions.

Will release a new version on the weekend, where I remove R65.

Cu Selur

[Selur]

Is there a min resolution for ProPainters input?
Using vclip.avi as source (320x288) and the attached mask, I get a broken output.

(I first thought that it was some interference issue with BasicVSR++, but I get basically the same output when not using it.)


Cu Selur

[Dan64]

Unfortunately ProPainter in this case cannot remove the mask. 
The output represent the frame when the inference fails to converge.

It works for the attached video (same video but with a small logo on the bottom right corner).  

Dan

[Selur]

Ah, okay, so from the look of it the mask/image resolution must at least have a width of 512 pixels.
Resizing the video to 512x420 and then applying a resized mask works fine.


Cu Selur

[Dan64]

It works even with your original avi clip.

The problem was your mask that was not of the same size.
Using the correct mask you get this result:



Try the attached mask and should work also on your side. 

Dan

[Selur]

Only difference I see between your png and mine is that mine uses 1bit and yours uses 24bit colors.
Using your mask and the clip it still does not work for me.

clip = ProPainter(clip=clip, img_mask_path="C:/Users/Selur/Desktop/mask_352x288.png", length=500)

You must be doing something different from me.
What does your script look like?

Cu Selur

[Dan64]

I attached: script, clip, mask

Dan

[Selur]

Now it works for me too.
Strange, must be some cosmic rays

[Dan64]

Now it works for me too. 
Strange, must be some cosmic rays 

I do agree with you. 
I still don't understand why is working. 
It seems something related to "png" format used to save mask.

---

To create the "working" mask, I used:

1) Corel Paint Shop Pro
2) Created a new image of size 352x288 (resolution 300 pixel/inch)
3) Image characteristics: Raster Background, Color Black (depth: RGB 8 bits/channel)
4) Added the mask
5) Saved the file as PNG: Noninterlaced, Optimized palette

Dan

[Selur]

Did you ever try to use ProPainter for outpainting?





I'm wondering whether changing some of the values can create better results,.... => nope, even length=500, neighbor_length=100, ref_stride=1, raft_iter=100 doesn't help

Cu Selur

Ps.: just updated the deoldify test download, since I noticed the 'Interference' didn't do a thing.
PPs.: does outpainting require vs-propainter to be adjusted in some way, or should this work?