x265 encoder keeps crashing for no reason

[NCF]

Hi, I'm trying to figure out why the x265 encoder keeps crashingPlease, read the 'Infos needed to fix&reproduce bugs,..'-sticky before you post about a problem.

[Selur]

Will look at it this evening after work.
Does the Vapoursynth Preview Work?

Cu Selur

[NCF]

Yes.  It's the x265 encoder that's crashing.

[Selur]

Hybrid aborts with " x265 output: x265 [error]: unable to open input file" while calling:

"C:\Program Files\Hybrid\64bit\Vapoursynth\vspipe.exe" "C:\Users\Jason Edades\AppData\Local\Temp\encodingTempSynthSkript_2024-01-29@22_21_03_1910_0.vpy" - -c y4m | "C:\Program Files\Hybrid\64bit\x265.exe" --input - --fps 24000/1001 --output-depth 12 --y4m --profile main12 --level-idc 6.2 --limit-modes --no-early-skip --no-open-gop --opt-ref-list-length-pps --weightb --ref 6 --lookahead-slices 0 --crf 10.00 --opt-qp-pps --cbqpoffs -2 --crqpoffs -2 --limit-refs 0 --ssim-rd --psy-rd 2.50 --rdoq-level 2 --psy-rdoq 10.00 --dynamic-rd 2.00 --aq-mode 1 --sbrc --vbv-maxrate 12000000 --vbv-bufsize 12000000 --deblock=-1:-1 --selective-sao 0 --sao-non-deblock --no-repeat-headers --fades --psnr --ssim --range limited --colormatrix bt709 --sar 1:1 --output "C:\Users\Jason Edades\AppData\Local\Temp\2024-01-29@22_21_03_1910_02.265"

normally this hints that something is wrong with the Vapoursynth script:

# Imports
import vapoursynth as vs
# getting Vapoursynth core
import sys
import os
core = vs.core
# Import scripts folder
scriptPath = 'C:/Program Files/Hybrid/64bit/vsscripts'
sys.path.insert(0, os.path.abspath(scriptPath))
# Loading Plugins
core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/MiscFilter/MiscFilters/MiscFilters.dll")
core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/Support/libvs_placebo.dll")
core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/GrainFilter/RemoveGrain/RemoveGrainVS.dll")
core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/DenoiseFilter/CTMF/CTMF.dll")
core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/Support/libmvtools.dll")
core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/DeblockFilter/DeblockPP7/DeblockPP7.dll")
core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/SourceFilter/LSmashSource/vslsmashsource.dll")
# Import scripts
import muvsfunc
import nnedi3_resample
import mvsfunc
import smdegrain
import havsfunc
# source: 'H:\Justin Uranus\Inferno-The Book Cut\Inferno (2016)\Inferno (2016) - Blu-Ray\Inferno (2016)_t08.mkv'
# current color space: YUV420P8, bit depth: 8, resolution: 1920x1080, fps: 23.976, color matrix: 709, yuv luminance scale: limited, scanorder: progressive
# Loading H:\Justin Uranus\Inferno-The Book Cut\Inferno (2016)\Inferno (2016) - Blu-Ray\Inferno (2016)_t08.mkv using LWLibavSource
clip = core.lsmas.LWLibavSource(source="H:/Justin Uranus/Inferno-The Book Cut/Inferno (2016)/Inferno (2016) - Blu-Ray/Inferno (2016)_t08.mkv", format="YUV420P8", stream_index=0, cache=0, prefer_hw=0)
# Setting detected color matrix (709).
clip = core.std.SetFrameProps(clip, _Matrix=1)
# Setting color transfer info (709)
clip = core.std.SetFrameProps(clip, _Transfer=1)
# Setting color primaries info (1)
clip = core.std.SetFrameProps(clip, _Primaries=1)
# Setting color range to TV (limited) range.
clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1)
# making sure frame rate is set to 23.976
clip = core.std.AssumeFPS(clip=clip, fpsnum=24000, fpsden=1001)
clip = core.std.SetFrameProp(clip=clip, prop="_FieldBased", intval=0) # progressive
# applying deblocking using DeblockPP7
clip = core.pp7.DeblockPP7(clip=clip)
clip = core.std.CropRel(clip=clip, left=16, right=16, top=32, bottom=32)# cropping to 1888x1016
# removing grain using SMDegrain
clip = smdegrain.SMDegrain(input=clip, tr=1, RefineMotion=True, interlaced=False)
# applying debanding using vs-placebo.Deband
clip = core.placebo.Deband(clip=clip, planes=1|2|4)
clip = muvsfunc.BlindDeHalo3(clip, lodamp=4.00, hidamp=4.00, interlaced=False)
# deringing using HQDeringmod
clip = havsfunc.HQDeringmod(clip, nrmode=2, darkthr=3.0)
# adjusting output color from: YUV420P8 to YUV420P12 for x265Model
clip = core.resize.Bicubic(clip=clip, format=vs.YUV420P12, range_s="limited", dither_type="error_diffusion")
# set output frame rate to 23.976fps (progressive)
clip = core.std.AssumeFPS(clip=clip, fpsnum=24000, fpsden=1001)
# Output
clip.set_output()

But since you wrote that the Vapoursynth Preview works fine the next thing is that:
1. some over active anti virus or similar tool is interfering
2. some memory issue which is only triggered when encoder and decoder use the ram

Do other encoder work?

Cu Selur

[NCF]

I tried other encoders.  It still crashed.

[Selur]

Okay, so it isn't just a x265 issue.
try:
a. setting your temp folder to a folder output of your AppData folder
b. disabling virus scanners or similar (<- especially when H is not a local drive)



Cu Selur

[NCF]

It's still crashing randomly.

[Selur]

Randomly, during encoding of the same or different sources?
Ranomly sound like some memory or asm issue or heat issue.

Cu Selur

[NCF]

Different sources

[Selur]

Does it also crash if you simplify the script?