Deoldify Vapoursynth filter

[zspeciman]

I have a black & white test video that was colorized with ddcolor, DeepEx HAVC only with one setting and DeepEx HAVC only with a different settings.
I have attached the settings pics and the videos.  Unfortunately, I've reached the 20MB limit to upload here.  Selur, hopefully that is okay, I'm posting an external download link for them.
The DeepEx doesn't start the colorization for a few seconds after the video begins and afterwards the lady's skin looks a zombie like in some parts.  
DDcolor in this example does a nicer job in comparison.  

I suspect that the the scene threshold starts very late, so the beginning frames don't get colorized. 

Dan64, what do you think I'm doing wrong, what settings would you have used for this?  I figure best way to learn is thru example.
Is this a case where reference frames are needed to be created?

TestExamples