+- Selur's Little Message Board (https://forum.selur.net)
+-- Forum: Talk, Talk, Talk (https://forum.selur.net/forum-5.html)
+--- Forum: Small Talk (https://forum.selur.net/forum-7.html)
+--- Thread: ProPainter Vapoursynth filter (/thread-3720.html)
RE: ProPainter Vapoursynth filter - Selur - 29.06.2024
Ah, okay, I assumed/hoped that they would use another model or analyze the surrounding frames differently. So my previous tests were 'correct'.
As it is, you are correct, adding this to the normal release doesn't change anything, but thanks for looking into it.
So for outpainting atm. something like midjorney would be needed, which really would be overkill.
Cu Selur
Ps.: there is hope, https://be-your-outpainter.github.io/ (https://arxiv.org/pdf/2403.13745) looks impressive. (no source code as far as I see atm.)
RE: ProPainter Vapoursynth filter - Dan64 - 29.06.2024
To be more precise there is some little difference between the inpainting and outpainting mode.
As example consider this frame
Using the inpainting mode with the mask on the edges is obtained this frame
while using the outpainting mode, the lateral edges are a little better
Since this clip is moving only up, ProPainter is able to draw successfully the upper/lower edges, but has not enough information to draw successfully the lateral edges.
I will release a new version with the outpainting mode implemented.
In the new release will be the following functions:
- propainter_inpaint() : exactly the same as previous propainter()
- propainter_outpaint() : propainter in outpainting mode
- propainter() : a wrapper to the 2 functions above (with defaults switching to propainter_inpaint).
Is up to you decide if add the outpainting mode or not.
Dan
RE: ProPainter Vapoursynth filter - Selur - 29.06.2024
I'll add support for it in Hybrid, since at least for small edges it seems helpful.
Cu Selur
RE: ProPainter Vapoursynth filter - Dan64 - 29.06.2024
Published the new release: https://github.com/dan64/vs-propainter/releases/tag/v1.2.0
Dan
RE: ProPainter Vapoursynth filter - Selur - 29.06.2024
Will send you a new link once I added it to Hybrid.
Cu Selur
RE: ProPainter Vapoursynth filter - Selur - 29.06.2024
Argh, integration is trickier than anticipated.
Not sure how I can properly incorporate ProPainers outpainting in Hybrid, output resolution handling gets tricky when a filter can change the resolution and that filter is no resizer,...
=> this will take a while
(atm. Hybrid can rely on a fixed order between Crop < Rotation < Resize < Letterbox, and thus handle PAR&Co properly)
Cu Selur
RE: ProPainter Vapoursynth filter - Selur - 29.06.2024
Send you a link to a propainter dev Hybrid version which should work fine with outpainting.
Cu Selur
RE: ProPainter Vapoursynth filter - Dan64 - 29.06.2024
The new dev version is working fiine.
Thanks,
Dan
RE: ProPainter Vapoursynth filter - jamesharding26 - 25.10.2024
Hi all,
I am trying to run the script and running into an error that I don't understand, if anyone can help that would be much appreciated
Failed to evaluate the script:
Python exception: list index out of range
Traceback (most recent call last):
File "src\\cython\\vapoursynth.pyx", line 3233, in vapoursynth._vpy_evaluate
File "src\\cython\\vapoursynth.pyx", line 3234, in vapoursynth._vpy_evaluate
File "", line 11, in
File "C:\Users\James\AppData\Local\Programs\Python\Python312\Lib\site-packages\vspropainter\__init__.py", line 24, in
from vspropainter.propainter_render import ModelProPainterIn, ModelProPainterOut
File "C:\Users\James\AppData\Local\Programs\Python\Python312\Lib\site-packages\vspropainter\propainter_render.py", line 22, in
from vspropainter.model.recurrent_flow_completion import RecurrentFlowCompleteNet
File "C:\Users\James\AppData\Local\Programs\Python\Python312\Lib\site-packages\vspropainter\model\recurrent_flow_completion.py", line 7, in
from vspropainter.model.misc import constant_init
File "C:\Users\James\AppData\Local\Programs\Python\Python312\Lib\site-packages\vspropainter\model\misc.py", line 57, in
IS_HIGH_VERSION = [int(m) for m in list(re.findall(r"^(\d+)\.(\d+)\.(\d+)([\w\d\.].*)?$",\
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
IndexError: list index out of rangeThanks
James
RE: ProPainter Vapoursynth filter - Selur - 25.10.2024
No clue, never tried using proPainter outside of Hybrid.
But hopefully Dan64 can help.