[BUG] Hybrid 2022.11.28.1, y4m bad sequence header issue

[Nickme]

Hi Selur,
I am using Hybrid 2022.11.28.1 on windows 11 ARM (through parallels desktop on MacBook m1).
Earlier version was working good. But after updating to this version, settings the error, 

x264 output: y4m [error]: bad sequence header magic
x264 [error]: could not open input file `-'

Debug zip file is attached. I am simply putting input file. defining output file name. selected deinterlacing QTGMC with bob option checked. x264 output. 

Here is video file:
https://drive.google.com/file/d/18L6aI8B...share_link

Please, read the 'Infos needed to fix&reproduce bugs,..'-sticky before you post about a problem.

[Selur]

Will look at it after work and report back.

y4m [error]: bad sequence header magic

usually indicates an issue with the Vapoursynth script
-> does the Vapoursynth preview work properly ?

At a first glance, the used script:

# Imports
import vapoursynth as vs
import os
import ctypes
# Loading Support Files
Dllref = ctypes.windll.LoadLibrary("C:/Program Files (x86)/Hybrid/64bit/vsfilters/Support/libfftw3f-3.dll")
import sys
# getting Vapoursynth core
core = vs.core
# Import scripts folder
scriptPath = 'C:/Program Files (x86)/Hybrid/64bit/vsscripts'
sys.path.insert(0, os.path.abspath(scriptPath))
# Loading Plugins
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/GrainFilter/RemoveGrain/RemoveGrainVS.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/GrainFilter/AddGrain/AddGrain.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/DenoiseFilter/FFT3DFilter/fft3dfilter.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/DenoiseFilter/DFTTest/DFTTest.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/Support/EEDI3m.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/ResizeFilter/nnedi3/vsznedi3.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/Support/libmvtools.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/Support/scenechange.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/Support/fmtconv.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/MiscFilter/MiscFilters/MiscFilters.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/DeinterlaceFilter/Bwdif/Bwdif.dll")
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/SourceFilter/LSmashSource/vslsmashsource.dll")
# Import scripts
import havsfunc
# source: 'C:\Users\kiaara\Downloads\Video Processing\002 Test.avi'
# current color space: YUV420P8, bit depth: 8, resolution: 720x576, fps: 25, color matrix: 470bg, yuv luminance scale: limited, scanorder: bottom field first
# Loading C:\Users\kiaara\Downloads\Video Processing\002 Test.avi using LWLibavSource
clip = core.lsmas.LWLibavSource(source="C:/Users/kiaara/Downloads/Video Processing/002 Test.avi", format="YUV420P8", stream_index=0, cache=0, prefer_hw=0)
# Setting color matrix to 470bg.
clip = core.std.SetFrameProps(clip, _Matrix=5)
clip = clip if not core.text.FrameProps(clip,'_Transfer') else core.std.SetFrameProps(clip, _Transfer=5)
clip = clip if not core.text.FrameProps(clip,'_Primaries') else core.std.SetFrameProps(clip, _Primaries=5)
# Setting color range to TV (limited) range.
clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1)
# making sure frame rate is set to 25
clip = core.std.AssumeFPS(clip=clip, fpsnum=25, fpsden=1)
clip = core.std.SetFrameProp(clip=clip, prop="_FieldBased", intval=1)
# setting field order to what QTGMC should assume (bottom field first)
clip = core.std.SetFrameProp(clip=clip, prop="_FieldBased", intval=1)
# Deinterlacing using QTGMC
clip = havsfunc.QTGMC(Input=clip, Preset="Fast", TFF=False) # new fps: 25
# make sure content is preceived as frame based
clip = core.std.SetFieldBased(clip, 0)
clip = clip[::2]
# set output frame rate to 25fps
clip = core.std.AssumeFPS(clip=clip, fpsnum=25, fpsden=1)
# Output
clip.set_output()

looks fine, and so does the encoding call:

"C:\Program Files (x86)\Hybrid\64bit\Vapoursynth\vspipe.exe" "C:\Users\kiaara\Downloads\encodingTempSynthSkript_2022-12-09@06_17_43_1510.vpy" - -c y4m | "C:\Program Files (x86)\Hybrid\64bit\x264.exe" --preset veryfast --pass 1 --bitrate 1500 --profile high --level 4.1 --direct auto --b-adapt 0 --sync-lookahead 6 --qcomp 0.50 --rc-lookahead 40 --qpmax 51 --aq-mode 0 --sar 64:45 --non-deterministic --range tv --stats "C:\Users\kiaara\Downloads\1_2022-12-09@06_17_43_1510_02.stats" --demuxer y4m --input-range tv --fps 25/1 --output-depth 8 --output NUL -

Cu Selur

Ps.: One only thing that seems strange is that Hybrid is installed under 'C:/Program Files (x86)' as a 64bit application it normally should be installed under 'C:/Program Files'. (Reencoding the file, works fine here)

[Nickme]

1. Vaporsynth preview gives error, attaching .vpy file showed when I clicked preview.

2022-12-09 12:50:11.817
Failed to evaluate the script:
Python exception: Failed to load C:/Program Files (x86)/Hybrid/64bit/vsfilters/DenoiseFilter/FFT3DFilter/fft3dfilter.dll. GetLastError() returned 1114.

Traceback (most recent call last):
File "src\cython\vapoursynth.pyx", line 2819, in vapoursynth._vpy_evaluate
File "src\cython\vapoursynth.pyx", line 2820, in vapoursynth._vpy_evaluate
File "C:\Users\kiaara\Downloads\tempPreviewVapoursynthFile12_49_52_753.vpy", line 16, in
core.std.LoadPlugin(path="C:/Program Files (x86)/Hybrid/64bit/vsfilters/DenoiseFilter/FFT3DFilter/fft3dfilter.dll")
File "src\cython\vapoursynth.pyx", line 2565, in vapoursynth.Function.__call__
vapoursynth.Error: Failed to load C:/Program Files (x86)/Hybrid/64bit/vsfilters/DenoiseFilter/FFT3DFilter/fft3dfilter.dll. GetLastError() returned 1114.

2. Hybrid took C:/Program Files (x86) location installation by default. I didn't change anything while installing.

Edit 1: I just uninstalled it completely. Installed again, this time in C:/Program Files/ folder. Still getting same error.

[Selur]

Okay, issue seems to be with fft3dfilter.dll or libfftw3f-3.dll which fft3dfilter.dll uses. :/
I could probably modify Hybrid to use Neo-FFT3DFilter, but that also relies on libfftw3f-3.dll.

So to know whether fft3dfilter or libfftw3f-3 is the problem,
a. use a progressive source
b. enable Filtering->Vapoursynth->Denoise->FFT3DFilter and check the Vapoursynth preview. This should also crash, since it uses fft3dfilter.dll. Then enable Filtering->Vapoursynth->Denoise->FFT3DFilter->Neo in which case instead of FFT3DFilter, Neo-FFT3DFilter will be used. So try the Vapoursynth Preview again, if it works then let me know and I'll adjust Hybrid and QTGMC so that it can use Neo-FFT3DFilter instead of FFT3DFilter.

If that fails to, your best option is to try to replace the libfftw3f-3.dll with the latest version from http://www.fftw.org/install/windows.html, that might help.

Cu Selur

[Selur]

Send you a link to a dev version (via pm) which has an additional 'Neo'-option for QTGMC which tells Hybrid/QTGMC to use Neo-FFT3DFilter instead of the normal FFT3DFilter.

Cu Selur

[Nickme]

Send you a link to a dev version (via pm) which has an additional 'Neo'-option for QTGMC which tells Hybrid/QTGMC to use Neo-FFT3DFilter instead of the normal FFT3DFilter.

Cu Selur

Thanks for the new build, Selur. Both issues still exist in your new build also. I uninstalled older one completely. Installed your new build from PM.
log file is attached here.

[Selur]

In the debug output you did not try the 'neo'-option, so fft3dfilter.dll was still used and nothing was gained from using the new verison.
Please try, whether it works with the 'neo'-option enabled.

Cu Selur

[Nickme]

In the debug output you did not try the 'neo'-option, so fft3dfilter.dll was still used and nothing was gained from using the new verison.
Please try, whether it works with the 'neo'-option enabled.

Cu Selur

Thanks Selur. I forgot to check Neo box earlier. Both the issues got resolved now 

Another thing is, I am encoding x264 mp4 file with mp3 audio. but getting this issue. My final video mp4 file is without audio. Am I doing something wrong here. I tried changing temp folder also but getting same issue so reverted to default.
debug file is attached. Attaching screenshots of settings.

added new job with id 2022-12-10@11_40_31_1910
starting 2022-12-10@11_40_31_1910_01_audio@11:40:31.354 - C:\Users\kiaara\Downloads\Video Processing\1.mp4
2022-12-10@11_40_31_1910_01_audio finished after 00:00:00.302
starting 2022-12-10@11_40_31_1910_02_audio@11:40:31.665 - C:\Users\kiaara\Downloads\Video Processing\1.mp4
2022-12-10@11_40_31_1910_02_audio finished after 00:00:03.027
Couldn't get free space in folder(), assuming zero.
delete C:\Users\kiaara\AppData\Local\Temp\iId_1_aid_1_DELAY_-43ms_2022-12-10@11_40_31_1910_01.wav
starting 2022-12-10@11_40_31_1910_05_video@11:40:34.733 - C:\Users\kiaara\Downloads\Video Processing\1.mp4
2022-12-10@11_40_31_1910_05_video finished after 00:00:50.812
delete C:\Users\kiaara\AppData\Local\Temp\encodingTempSynthSkript_2022-12-10@11_40_31_1910.vpy
starting 2022-12-10@11_40_31_1910_08_muxing@11:41:25.580 - C:\Users\kiaara\Downloads\Video Processing\1.mp4
2022-12-10@11_40_31_1910_08_muxing finished after 00:00:00.613
delete C:\Users\kiaara\AppData\Local\Temp\2022-12-10@11_40_31_1910_05.264
delete C:\Users\kiaara\AppData\Local\Temp\iId_1_aid_1_ms_2022-12-10@11_40_31_1910_02.aac
Job 2022-12-10@11_40_31_1910 finished!

[Selur]

debug file is attached. Attaching screenshots of settings.

Nope, debug output isn't attached. Without a debug output I have no clue what is happening.

I forgot to check Neo box earlier. Both the issues got resolved now

Okay, so it is an incompatibility with fft3dfilter and your system. Happy that using neo-fft3dfilter helps.

Cu Selur

[Nickme]

debug file is attached. Attaching screenshots of settings.

Nope, debug output isn't attached. Without a debug output I have no clue what is happening.

Sorry. here it is.