This forum uses cookies
This forum makes use of cookies to store your login information if you are registered, and your last visit if you are not. Cookies are small text documents stored on your computer; the cookies set by this forum can only be used on this website and pose no security risk. Cookies on this forum also track the specific topics you have read and when you last read them. Please confirm whether you accept or reject these cookies being set.

A cookie will be stored in your browser regardless of choice to prevent you being asked this question again. You will be able to change your cookie settings at any time using the link in the footer.

ProPainter Vapoursynth filter
@Dan64: I'm trying to remove the logo mentioned here of this clip.
I created a video mask
Code I used to create the logo:
clip = clip.resize.Bicubic(format=vs.RGBS)

# Extract R, G, B planes
r = clip.std.ShufflePlanes(0, vs.GRAY)
g = clip.std.ShufflePlanes(1, vs.GRAY)
b = clip.std.ShufflePlanes(2, vs.GRAY)

# Build an expression that detects yellow-ish pixels:
# - R and G are both high (>= 0.6)
# - B is relatively low (<= 0.5)
expr = "x 0.6 > y 0.6 > and z 0.5 < and x y - abs 0.1 < and 1 0 ?"
mask = core.std.Expr([r, g, b], expr=[expr])

# Clean up the mask
clip = mask.std.Inflate().std.Minimum().std.Minimum().std.Convolution(matrix=[1]*9).std.Maximum().std.Maximum()
clip = core.std.SetFrameProps(clip, _Matrix=vs.MATRIX_BT709)
# colorformat GRAYS
which seems fine covering the logo for most of the clip.
Problem is when using:
# Inpainting using ProPainter
from vspropainter import propainter as ProPainter
clipMask = core.lsmas.LWLibavSource(source="G:/Output/logo_mask2.mp4", format="RGB24", cache=0)
clip = ProPainter(clip=clip, clip_mask=clipMask, length=500, neighbor_length=20, raft_iter=10, mask_region=(500,256,390,240))
starting with frame 149 the logo reappears (isn't properly removed).
[Image: grafik.png]
the mask clip properly covers the logo:
[Image: grafik.png]
If I reduce the length to 20, logo is gone until 160,...
I first thought this could this be a bug in the length&co parameter handling, for the edge case where the end of the clip is approached, in the wrapper.
To test my theory, I added clip + core.std.Reverse(clip).std.Trim(1), created a new mask clip and used that to look at frame 149+.
That didn't help, it even seemed to make it worse. Then I thought maybe the scene threshold was the issue, so I set that to 0, but that also didn't help.
Last thing I tried was disabling the mask region, but that also didn't really help either.
Do you think this is a problem of:
a. finding the right parameters
b. a bug in the wrapper
c. ProPainter just strangely failing
?

Cu Selur
----
Dev versions are in the 'experimental'-folder of my GoogleDrive, which is linked on the download page.
Reply


Messages In This Thread
ProPainter Vapoursynth filter - by Selur - 28.05.2024, 14:23
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 15:15
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 15:47
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 18:04
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 18:23
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 18:30
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 18:43
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 19:05
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 19:28
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 19:43
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 19:58
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 20:10
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 20:17
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 20:28
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 20:33
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 20:36
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 20:40
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 21:21
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 22:06
RE: ProPainter Vapoursynth filter - by Selur - 28.05.2024, 22:52
RE: ProPainter Vapoursynth filter - by Dan64 - 28.05.2024, 22:56
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 07:13
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 09:08
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 15:55
RE: ProPainter Vapoursynth filter - by Dan64 - 29.05.2024, 17:12
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 17:14
RE: ProPainter Vapoursynth filter - by Dan64 - 29.05.2024, 17:38
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 17:45
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 17:56
RE: ProPainter Vapoursynth filter - by Dan64 - 29.05.2024, 18:52
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 20:45
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 20:56
RE: ProPainter Vapoursynth filter - by Dan64 - 29.05.2024, 21:48
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 21:50
RE: ProPainter Vapoursynth filter - by Selur - 29.05.2024, 22:30
RE: ProPainter Vapoursynth filter - by Selur - 30.05.2024, 11:01
RE: ProPainter Vapoursynth filter - by Dan64 - 30.05.2024, 20:21
RE: ProPainter Vapoursynth filter - by Selur - 30.05.2024, 20:27
RE: ProPainter Vapoursynth filter - by Dan64 - 30.05.2024, 20:37
RE: ProPainter Vapoursynth filter - by Selur - 30.05.2024, 21:03
RE: ProPainter Vapoursynth filter - by Dan64 - 30.05.2024, 22:06
RE: ProPainter Vapoursynth filter - by Selur - 31.05.2024, 06:39
RE: ProPainter Vapoursynth filter - by Selur - 31.05.2024, 07:20
RE: ProPainter Vapoursynth filter - by Dan64 - 31.05.2024, 17:54
RE: ProPainter Vapoursynth filter - by Selur - 31.05.2024, 17:59
RE: ProPainter Vapoursynth filter - by Selur - 31.05.2024, 19:17
RE: ProPainter Vapoursynth filter - by Dan64 - 31.05.2024, 22:07
RE: ProPainter Vapoursynth filter - by Selur - 01.06.2024, 07:00
RE: ProPainter Vapoursynth filter - by Dan64 - 01.06.2024, 09:59
RE: ProPainter Vapoursynth filter - by Selur - 01.06.2024, 10:06
RE: ProPainter Vapoursynth filter - by Dan64 - 01.06.2024, 10:27
RE: ProPainter Vapoursynth filter - by Selur - 01.06.2024, 10:37
RE: ProPainter Vapoursynth filter - by Dan64 - 01.06.2024, 13:55
RE: ProPainter Vapoursynth filter - by Dan64 - 01.06.2024, 23:11
RE: ProPainter Vapoursynth filter - by Selur - 02.06.2024, 08:20
RE: ProPainter Vapoursynth filter - by Dan64 - 02.06.2024, 08:48
RE: ProPainter Vapoursynth filter - by Selur - 02.06.2024, 09:01
RE: ProPainter Vapoursynth filter - by Dan64 - 02.06.2024, 09:33
RE: ProPainter Vapoursynth filter - by Selur - 02.06.2024, 09:38
RE: ProPainter Vapoursynth filter - by Dan64 - 04.06.2024, 18:40
RE: ProPainter Vapoursynth filter - by Dan64 - 04.06.2024, 19:07
RE: ProPainter Vapoursynth filter - by Selur - 04.06.2024, 19:09
RE: ProPainter Vapoursynth filter - by Dan64 - 04.06.2024, 19:17
RE: ProPainter Vapoursynth filter - by Selur - 04.06.2024, 19:34
RE: ProPainter Vapoursynth filter - by Dan64 - 04.06.2024, 19:50
RE: ProPainter Vapoursynth filter - by Selur - 04.06.2024, 19:59
RE: ProPainter Vapoursynth filter - by Dan64 - 05.06.2024, 18:37
RE: ProPainter Vapoursynth filter - by Selur - 05.06.2024, 19:14
RE: ProPainter Vapoursynth filter - by Dan64 - 05.06.2024, 20:23
RE: ProPainter Vapoursynth filter - by Selur - 06.06.2024, 15:06
RE: ProPainter Vapoursynth filter - by Selur - 06.06.2024, 16:24
RE: ProPainter Vapoursynth filter - by Dan64 - 06.06.2024, 18:28
RE: ProPainter Vapoursynth filter - by Selur - 06.06.2024, 18:33
RE: ProPainter Vapoursynth filter - by Dan64 - 06.06.2024, 18:45
RE: ProPainter Vapoursynth filter - by Selur - 06.06.2024, 18:50
RE: ProPainter Vapoursynth filter - by safshe - 11.06.2024, 09:04
RE: ProPainter Vapoursynth filter - by Selur - 11.06.2024, 17:00
RE: ProPainter Vapoursynth filter - by Dan64 - 11.06.2024, 17:27
RE: ProPainter Vapoursynth filter - by Selur - 11.06.2024, 17:33
RE: ProPainter Vapoursynth filter - by Selur - 22.06.2024, 13:48
RE: ProPainter Vapoursynth filter - by Dan64 - 22.06.2024, 23:31
RE: ProPainter Vapoursynth filter - by Selur - 23.06.2024, 07:16
RE: ProPainter Vapoursynth filter - by Dan64 - 23.06.2024, 10:00
RE: ProPainter Vapoursynth filter - by Selur - 23.06.2024, 10:11
RE: ProPainter Vapoursynth filter - by Dan64 - 23.06.2024, 10:25
RE: ProPainter Vapoursynth filter - by Selur - 23.06.2024, 10:29
RE: ProPainter Vapoursynth filter - by Dan64 - 23.06.2024, 10:37
RE: ProPainter Vapoursynth filter - by Selur - 27.06.2024, 20:25
RE: ProPainter Vapoursynth filter - by Dan64 - 28.06.2024, 17:58
RE: ProPainter Vapoursynth filter - by Selur - 28.06.2024, 18:04
RE: ProPainter Vapoursynth filter - by Dan64 - 28.06.2024, 18:16
RE: ProPainter Vapoursynth filter - by Selur - 28.06.2024, 18:18
RE: ProPainter Vapoursynth filter - by Dan64 - 28.06.2024, 18:27
RE: ProPainter Vapoursynth filter - by Selur - 28.06.2024, 18:28
RE: ProPainter Vapoursynth filter - by Dan64 - 28.06.2024, 20:39
RE: ProPainter Vapoursynth filter - by Selur - 28.06.2024, 20:53
RE: ProPainter Vapoursynth filter - by Selur - 28.06.2024, 21:12
RE: ProPainter Vapoursynth filter - by Dan64 - 28.06.2024, 22:49
RE: ProPainter Vapoursynth filter - by Selur - 29.06.2024, 08:08
RE: ProPainter Vapoursynth filter - by Dan64 - 29.06.2024, 08:30
RE: ProPainter Vapoursynth filter - by Selur - 29.06.2024, 08:41
RE: ProPainter Vapoursynth filter - by Dan64 - 29.06.2024, 09:19
RE: ProPainter Vapoursynth filter - by Selur - 29.06.2024, 09:23
RE: ProPainter Vapoursynth filter - by Selur - 29.06.2024, 10:47
RE: ProPainter Vapoursynth filter - by Selur - 29.06.2024, 19:40
RE: ProPainter Vapoursynth filter - by Dan64 - 29.06.2024, 20:56
RE: ProPainter Vapoursynth filter - by Selur - 25.10.2024, 11:43
RE: ProPainter Vapoursynth filter - by Selur - 25.10.2024, 12:49
RE: ProPainter Vapoursynth filter - by Dan64 - 28.10.2024, 18:40
RE: ProPainter Vapoursynth filter - by Selur - 28.10.2024, 18:46
RE: ProPainter Vapoursynth filter - by Dan64 - 29.10.2024, 00:21
RE: ProPainter Vapoursynth filter - by Dan64 - 29.10.2024, 11:01
RE: ProPainter Vapoursynth filter - by Selur - 20.07.2025, 07:08
RE: ProPainter Vapoursynth filter - by Dan64 - 20.07.2025, 10:07
RE: ProPainter Vapoursynth filter - by Dan64 - 20.07.2025, 23:11
RE: ProPainter Vapoursynth filter - by Selur - 21.07.2025, 04:29

Forum Jump:


Users browsing this thread: 1 Guest(s)