Selur's Little Message Board

Pages: 1 2

Sorry but I don't understand your question. HAVC is necessary to generate the reference frames, the proposed method will allow to "manually" adjust the reference frames before encode the final colored clip.

Using HAVC alone without any manual adjustment you can obtain the following results

Casablanca (1941) HD Trailer.HAVC_local.mkv

obtained using this script

Code:
clip = HAVC_main(clip=clip, Preset="medium", VideoTune="stable", ColorFix="violet/red", ColorTune="light", ColorMap="none", EnableDeepEx=True, DeepExMethod=0, DeepExPreset="medium", DeepExRefMerge=0, DeepExOnlyRefFrames=False, ScFrameDir=None, ScThreshold=0.10, ScThtOffset=10, ScMinFreq=15, ScMinInt=5, ScThtSSIM=0.65, ScNormalize=True, DeepExModel=0, DeepExEncMode=1, DeepExVivid=True, DeepExMaxMemFrames=0, enable_fp16=True)

Casablanca (1941) HD Trailer.HAVC_local_merge.mkv

obtained using this script

Code:
clip = HAVC_main(clip=clip, Preset="medium", VideoTune="stable", ColorFix="violet/red", ColorTune="light", ColorMap="none", EnableDeepEx=True, DeepExMethod=0, DeepExPreset="medium", DeepExRefMerge=2, DeepExOnlyRefFrames=False, ScFrameDir=None, ScThreshold=0.10, ScThtOffset=10, ScMinFreq=1, ScMinInt=5, ScThtSSIM=0.65, ScNormalize=True, DeepExModel=0, DeepExEncMode=1, DeepExVivid=True, DeepExMaxMemFrames=0, enable_fp16=True)

Dan

I Just released a new vs-deoldify version v4.6.0

Where I added, just for curiosity, 2 new models: siggraph17, eccv16

I added siggraph17 because is the model used by Adobe Photoshop Elements for coloring the pictures and by MAGIX Vegas Pro 22 for coloring the videos.

Here the Casablanca Trailer obtained using the model siggraph17: Casablanca (1941) HD Trailer_siggraph17.mkv

with the following code

Code:
from vsdeoldify import HAVC_ddeoldify

clip = HAVC_ddeoldify(clip=clip, method=1, ddcolor_p=[2, 16, 1, 0, True], ddtweak=False)

Here the same Trailer obtained using the eccv16 model: Casablanca (1941) HD Trailer_eccv16.mkv

using the code

Code:
from vsdeoldify import HAVC_ddeoldify

clip = HAVC_ddeoldify(clip=clip, method=1, ddcolor_p=[3, 16, 1, 0, True], ddtweak=False)

Where the color model eccv16 has less flashing red frames than siggraph17.

These model have the same instability and worse colors than DDcolor. So I tried to apply the same stabilization filters already developed for DDcolor.

Here the result obtained using the tweaks on siggraph17: Casablanca (1941) HD Trailer_siggraph17_tweaks.mkv

with the following code

Code:
from vsdeoldify import HAVC_ddeoldify

clip = HAVC_ddeoldify(clip=clip, method=1, ddcolor_p=[2, 16, 1, 0, True], ddtweak=True, ddtweak_p=[0.0, 1.0, 2.5, True, 0.3, 0.6, 0.7, 0.5, "300:360|0.8,0.1"], device_index=0)

from vsdeoldify import HAVC_stabilizer

clip = HAVC_stabilizer(clip=clip, dark=True, dark_p=[0.2, 0.8], smooth=True, smooth_p=[0.3, 0.7, 0.9, 0.1, "none"], stab=True, stab_p=[5, 'A', 1, 15, 0.2, 0.15], colormap="none", render_factor=28)

while here there is result obtained using the tweaks on eccv16: Casablanca (1941) HD Trailer_eccv16_tweaks.mkv

using the following code

Code:
from vsdeoldify import HAVC_ddeoldify

clip = HAVC_ddeoldify(clip=clip, method=1, ddcolor_p=[3, 16, 1, 0, True], ddtweak=True, ddtweak_p=[0.0, 1.0, 2.5, True, 0.3, 0.6, 0.7, 0.5, "300:360|0.8,0.1"], device_index=0)

from vsdeoldify import HAVC_stabilizer

clip = HAVC_stabilizer(clip=clip, dark=True, dark_p=[0.2, 0.8], smooth=True, smooth_p=[0.3, 0.7, 0.9, 0.1, "none"], stab=True, stab_p=[5, 'A', 1, 15, 0.2, 0.15], colormap="none", render_factor=28)

in my opinion the result obtained using the tweaks on eccv16 is quite satisfactory. The stabilization filters developed for DDcolor are able to improve the colored clip significantly.

But as the user of HAVC should already known, the best color stabilization is obtained by merging the frames with the ones colored using DeOldify.

Dan

Pages: 1 2

Dan64

Dan64