[GUIDE] HAVC Filter User Guide

[Dan64]

Sorry but I don't understand your question. HAVC is necessary to generate the reference frames, the proposed method will allow to "manually" adjust the reference frames before encode the final colored clip.

Using HAVC alone without any manual adjustment you can obtain the following results

Casablanca (1941) HD Trailer.HAVC_local.mkv

obtained using this script

clip = HAVC_main(clip=clip, Preset="medium", VideoTune="stable", ColorFix="violet/red", ColorTune="light", ColorMap="none", EnableDeepEx=True, DeepExMethod=0, DeepExPreset="medium", DeepExRefMerge=0, DeepExOnlyRefFrames=False, ScFrameDir=None, ScThreshold=0.10, ScThtOffset=10, ScMinFreq=15, ScMinInt=5, ScThtSSIM=0.65, ScNormalize=True, DeepExModel=0, DeepExEncMode=1, DeepExVivid=True, DeepExMaxMemFrames=0, enable_fp16=True)

Casablanca (1941) HD Trailer.HAVC_local_merge.mkv

obtained using this script

clip = HAVC_main(clip=clip, Preset="medium", VideoTune="stable", ColorFix="violet/red", ColorTune="light", ColorMap="none", EnableDeepEx=True, DeepExMethod=0, DeepExPreset="medium", DeepExRefMerge=2, DeepExOnlyRefFrames=False, ScFrameDir=None, ScThreshold=0.10, ScThtOffset=10, ScMinFreq=1, ScMinInt=5, ScThtSSIM=0.65, ScNormalize=True, DeepExModel=0, DeepExEncMode=1, DeepExVivid=True, DeepExMaxMemFrames=0, enable_fp16=True)

Dan

[Dan64]

I Just released a new vs-deoldify version v4.6.0

Where I added, just for curiosity, 2 new models: siggraph17, eccv16 

I added siggraph17 because is the model used by Adobe Photoshop Elements for coloring the pictures and by MAGIX Vegas Pro 22 for coloring the videos.

Here the Casablanca Trailer obtained using the model siggraph17: Casablanca (1941) HD Trailer_siggraph17.mkv

with the following code

from vsdeoldify import HAVC_ddeoldify
clip = HAVC_ddeoldify(clip=clip, method=1, ddcolor_p=[2, 16, 1, 0, True], ddtweak=False)

Here the same Trailer obtained using the eccv16 model: Casablanca (1941) HD Trailer_eccv16.mkv

using the code

from vsdeoldify import HAVC_ddeoldify
clip = HAVC_ddeoldify(clip=clip, method=1, ddcolor_p=[3, 16, 1, 0, True], ddtweak=False)

Where the color model eccv16 has less flashing red frames than siggraph17.

These model have the same instability and worse colors than DDcolor. So I tried to apply the same stabilization filters already developed for DDcolor.

Here the result obtained using the tweaks on siggraph17: Casablanca (1941) HD Trailer_siggraph17_tweaks.mkv

with the following code

from vsdeoldify import HAVC_ddeoldify
clip = HAVC_ddeoldify(clip=clip, method=1, ddcolor_p=[2, 16, 1, 0, True], ddtweak=True, ddtweak_p=[0.0, 1.0, 2.5, True, 0.3, 0.6, 0.7, 0.5, "300:360|0.8,0.1"], device_index=0)
from vsdeoldify import HAVC_stabilizer
clip = HAVC_stabilizer(clip=clip, dark=True, dark_p=[0.2, 0.8], smooth=True, smooth_p=[0.3, 0.7, 0.9, 0.1, "none"], stab=True, stab_p=[5, 'A', 1, 15, 0.2, 0.15], colormap="none", render_factor=28)

while here there is result obtained using the tweaks on eccv16: Casablanca (1941) HD Trailer_eccv16_tweaks.mkv

using the following code

from vsdeoldify import HAVC_ddeoldify
clip = HAVC_ddeoldify(clip=clip, method=1, ddcolor_p=[3, 16, 1, 0, True], ddtweak=True, ddtweak_p=[0.0, 1.0, 2.5, True, 0.3, 0.6, 0.7, 0.5, "300:360|0.8,0.1"], device_index=0)
from vsdeoldify import HAVC_stabilizer
clip = HAVC_stabilizer(clip=clip, dark=True, dark_p=[0.2, 0.8], smooth=True, smooth_p=[0.3, 0.7, 0.9, 0.1, "none"], stab=True, stab_p=[5, 'A', 1, 15, 0.2, 0.15], colormap="none", render_factor=28)

in my opinion the result obtained using  the tweaks on eccv16 is quite satisfactory. The stabilization filters developed for DDcolor are able to improve the colored clip significantly.

But as the user of HAVC should already known, the best color stabilization is obtained by merging the frames with the ones colored using DeOldify.

Dan