SeedVR2 expriences?

[Selur]

Does anyone use SeedVR2 ?
I know that it can be used through ComfyUI (leveraging ComfyUI-Manager and following SeedVR2 v2.5 Video Upscaling: Official Guide from the ComfyUI Integration Team | AInVFX Nov 7.

Haven't really tested this a lot, (I would probably need multiple faster gpus with lots of vram to really have fun with it) I'm wondering:
a. are there significant differences between the different SeedVR2 models?
b. what experiences do you have in regard to what prefiltering should be done before feeding a source to SeedVR2?
c. is it just me or does the 3b model somehow create somewhat strange/creepy skin?
d. is there

Cu Selur

[Dan64]

I tried the workflow SeedVR2 1080p-template available in ComfyUI (see attachment).

On my RTX5070Ti it was able to resize a small clip of size 640x504 to 1370x1080 at a speed of about 2.0 fps, using only the 16GB of VRAM (shared VRAM was not used).

Not too bad for a DiT model, but still slow.

Dan

[Dan64]

Here a comparison between SeedVR2, Lancozs, RealEsrgasn_x2plus and BasicVSR++

https://imgsli.com/NDQ2Nzk1/2/1

SeedVR2 seems to provide sharper images respect to the other upscalers (I was unable to get "x4 ESRGAN" working on my side).

[Selur]

I was unable to get "x4 ESRGAN" working on my side

Strange works fine here (in Hybrid).

NNEDI3:

ESRGAN-x2plus:

ESRGAN-x4:

Waifu2x:

RealESRGAN-OpenProteus

BasicVSR++ Vimeo-90-K-BD:

RealSR:

SRMD:

SwinIR Lx4:

SwinIR Sx4:

SeedVSR2:

(note: SeedVSR2 has slightliy different resolution, since the PAR wasn't adjusted)
all files: https://www.mediafire.com/folder/sj4adnb...omparision

I think 'sharper' is the wrong term.
To me SeedVR2 does really sharpen more, but does add (invent) more details.

Cu Selur

[Selur]

Does anyone know how to change the video encoding settings in ComfyUI ? (instead of crf23 I'd like to use lossless encoding 4:4:4)

Cu Selur

[Dan64]

In this case RealESRGAN x4 to me seems better than SeedVSR2: https://imgsli.com/NDQ2ODk0

Are you sure that you posted the correct SeedVSR2.png picture ?

Dan

[Selur]

Yeah, pretty sure. (deleted the file but can re-create it later and check again)

[Selur]

Here's how the 1320x1080 version of suzie using seedvr2 looks like:    

also checked the other version and the uploaded view is correct.

[Selur]

Any suggestion how to limit normal RAM (not VRAM) usage?
Wanted to filter some 1080p content, not really upscale, but I get: DefaultCPUAllocator: not enough memory: you tried to allocate 59719680000 bytes.

Cu Selur

Ps.: just noticed my ComfyUI is 0.6 and current is 0.10 => updating now, maybe that fixes the issue

[Selur]

okay, seems to be an issue with the my source.