Audio encoding crash

[Devilman1]

The intermediate ac3 file in the Temp directory works fine.
But according to Mediainfo the Audio track of the file is 207 GiB:

Formato                                : AVI
Formato/Informazioni                    : Audio Video Interleave
Profilo formato                        : OpenDML
Dimensione                              : 1,79 GiB
Durata                                  : 2 o 27 min
Bitrate totale                          : 1.730 kb/s
Creato con                              : MEncoder SVN-r38184-9.3.0
Compressore                            : MPlayer

Video
ID                                      : 0
Formato                                : MPEG-4 Visual
Profilo formato                        : Advanced Simple@L5
Impostazioni formato                    : BVOP2
Impostazioni formato, BVOP              : 2
Impostazioni formato, QPel              : No
Impostazioni formato, GMC              : No warppoints
Impostazioni formato, Matrix            : Default (H.263)
ID codec                                : XVID
ID codec/Suggerimento                  : XviD
Durata                                  : 2 o 27 min
Bitrate                                : 1.495 kb/s
Larghezza                              : 716 pixel
Altezza                                : 388 pixel
Rapporto aspetto visualizzazione        : 1,85:1
Frame rate                              : 23,976 (24000/1001) FPS
Spazio colore                          : YUV
Croma subsampling                      : 4:2:0
Profondità bit                          : 8 bit
Tipo scansione                          : Progressivo
Modo compressione                      : Con perdita
Bit/(pixel*frame)                      : 0.224
Dimensione della traccia                : 1,54 GiB (86%)
Compressore                            : XviD 69

Audio
ID                                      : 1
Formato                                : AC-3
Formato/Informazioni                    : Audio Coding 3
ID codec                                : 2000
Durata                                  : 2 o 27 min
Bitrate                                : 201 Mb/s
Canali                                  : 2 canali
Frequenza campionamento                : 48,0 kHz
Modo compressione                      : Con perdita
Dimensione della traccia                : 207 GiB
Allineamento                            : Audio allineato
Duration_Source                        : General_Duration

I think that something happens during the multiplex.

[Selur]

Have you tried another source?
Like I said I can't reproduce the issue, so if you can provide a small sample and specific settings which allow me to reproduce the issue I can look at it again.

Cu Selur

[Devilman1]

Can you suggest me a lossless mkv Cutter?


Edit:
I try LossLess Cut and it produced a 23 minutes segment that plays fine in VLC, but the video encoding in Hybrid produce a 1 second avi.

Do you have a place where I could upload this segment?

I attach the Debug output.

[Selur]

According to the debug output the decoding of the input crashed.

Do you have a place where I could upload this segment?

Nope, gave up on that since folks abused it.
-> upload it to google drive or similar and send me a link via pm

Cu Selur

[Selur]

Okay, loaded the source and the first thing I noticed is:

Adjusting frame count (212538) to time code entry count (33730).

so whatever you used for the cut didn't make a good job.
(hopefully the original does not have the same problems)

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L5.1@High
HDR format                               : SMPTE ST 2086, HDR10 compatible
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 23 min 26 s
Bit rate                                 : 24.6 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 076 pixels
Display aspect ratio                     : 1.85:1
Frame rate mode                          : Variable
Frame rate                               : 151.072 FPS <- ARGH
Original frame rate                      : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0 (Type 2)
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.020
Stream size                              : 25.4 GiB <- ARGH
Writing library                          : x265 3.3+33-04275ae58030:[Windows][GCC 10.1.0][64 bit] 10bit
Encoding settings                        : cpuid=1176575 / frame-threads=6 / numa-pools=36 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=3840x2076 / interlace=0 / total-frames=212538 / level-idc=51 / high-tier=1 / uhd-bd=0 / ref=4 / no-allow-non-conformance / repeat-headers / annexb / aud / hrd / info / hash=0 / no-temporal-layers / open-gop / min-keyint=23 / keyint=250 / gop-lookahead=0 / bframes=4 / b-adapt=2 / b-pyramid / bframe-bias=0 / rc-lookahead=25 / lookahead-slices=4 / scenecut=40 / hist-scenecut=0 / radl=0 / no-splice / no-intra-refresh / ctu=64 / min-cu-size=8 / rect / no-amp / max-tu-size=32 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=2 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / strong-intra-smoothing / max-merge=3 / limit-refs=3 / limit-modes / me=3 / subme=3 / merange=57 / temporal-mvp / no-frame-dup / no-hme / weightp / no-weightb / no-analyze-src-pics / deblock=-3:-3 / no-sao / no-sao-non-deblock / rd=4 / selective-sao=0 / no-early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / no-b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=2.00 / psy-rdoq=1.00 / no-rd-refine / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=crf / crf=19.5 / qcomp=0.60 / qpstep=4 / stats-write=0 / stats-read=0 / vbv-maxrate=160000 / vbv-bufsize=160000 / vbv-init=0.9 / crf-max=0.0 / crf-min=0.0 / ipratio=1.40 / pbratio=1.30 / aq-mode=2 / aq-strength=1.00 / cutree / zone-count=0 / no-strict-cbr / qg-size=32 / no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=1 / overscan=0 / videoformat=5 / range=0 / colorprim=9 / transfer=16 / colormatrix=9 / chromaloc=1 / chromaloc-top=2 / chromaloc-bottom=2 / display-window=0 / master-display=G(13250,34500)B(7500,3000)R(34000,16000)WP(15635,16450)L(10000000,50) / cll=989,135 / min-luma=0 / max-luma=1023 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / hist-threshold=0.01 / no-opt-cu-delta-qp / no-aq-motion / hdr10 / hdr10-opt / no-dhdr10-opt / no-idr-recovery-sei / analysis-reuse-level=0 / analysis-save-reuse-level=0 / analysis-load-reuse-level=0 / scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=1 / refine-ctu-distortion=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-analysis-type=0 / copy-pic=1 / max-ausize-factor=1.0 / no-dynamic-refine / no-single-sei / no-hevc-aq / no-svt / no-field / qp-adaptation-range=1.00 / no-scenecut-aware-qpconformance-window-offsets / right=0 / bottom=0 / decoder-max-rate=0
Default                                  : Yes
Forced                                   : No
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : Display P3
Mastering display luminance              : min: 0.0050 cd/m2, max: 1000 cd/m2
Maximum Content Light Level              : 989 cd/m2
Maximum Frame-Average Light Level        : 135 cd/m2

You could have used MKVToolnix to cut the clip by time.
-> I used Hybrid to remux the file (audio&video passthrough while dropping the timecodes and all the subtitles).

Will try to reproduce your problem using that remuxed sample and report back.

Cu Selur

[Devilman1]

If you need I will try to redo the cut with MkvToolnix, but I didn't find how.

[Selur]

Remuxing didn't really help the headers are all over the place. Frame count is still totally wrong.
I enabled 'Config->Internals->Handling->Prefer Original->Frame rate' so that Hybrid will recognice the source as 23.976 (the info from the stream and not from the contains) and I also changed 'Filtering->Vapoursynth->Misc->Mibav hardware decoding mode' to '1', do speed up decoding (didn't do much, since the main ).
Vapoursynth script looks like this:

# Imports
import os
import sys
import vapoursynth as vs
core = vs.get_core()
# Import scripts folder
scriptPath = 'I:/Hybrid/64bit/vsscripts'
sys.path.append(os.path.abspath(scriptPath))
# Loading Plugins
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/Support/fmtconv.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/SourceFilter/LSmashSource/vslsmashsource.dll")
# Import scripts
import tmap
# input color space: YUV420P10, bit depth: 10
# Loading F:\cut_av_passthrough.mkv using LWLibavSource
clip = core.lsmas.LWLibavSource(source="F:/cut_av_passthrough.mkv", format="YUV420P10", cache=0, prefer_hw=1)
# making sure input color matrix is set as 2020ncl
clip = core.resize.Point(clip, matrix_in_s="2020ncl",range_s="limited")
# making sure frame rate is set to 23.976
clip = core.std.AssumeFPS(clip, fpsnum=24000, fpsden=1001)
# Setting color range to TV (limited) range.
clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1)
# Color Adjustment
clip = tmap.hablehdr10tosdr(clip=clip, source_peak=1000, desat=50, tFormat=vs.YUV420P8, tMatrix="709", tRange="limited", color_loc="center", lin="True", show_satmask="False", show_clipped="False")
clip = core.fmtc.resample(clip=clip, kernel="spline16", w=716, h=388, interlaced=False, interlacedd=False)
# adjusting output color from: YUV420P16 to YUV420P8 for xvidModel (i420)
clip = core.resize.Bicubic(clip=clip, format=vs.YUV420P8, range_s="limited")
# Output
clip.set_output()

and Vapoursynth preview works fine.
Video encoding started without a problem and is runnding at 3fps atm.
Video decoding and encoding did not crash like in your debug output.

Since the muxing was the main issue I aborted here and send configured Hybrid to only encode 10sec of the clip, created the job anew and started encoding.
Encoding worked fine and audio player fine.
(Found an issue that Vapoursynth should have enforced cfr decoding, but I fixed that.)

-> can't reproduce the video decoding crash or the muxing problem so far.

Are your sure your system is stable, not overclocked and has no heat and/or memory issues?
Also check your free space (Hybrid does not delete temp files when a job crashes).

Did a full reencode of the full clip you shared with me, but I used 'HDR10 to SDR (DG)' instead of 'HDR10toSDR' since it uses the gpu which speeds up tone mapping quite a bit. (1st and 2nd pass running at 17fps instead of 3fps).
And audio muxing worked fine.

Cu Selur

[Devilman1]

My system is not overclocked and untill now it works fine, the only problem that I have is that since a windows update sometime pop up the info that a new audio device was connected.

System Spec:

CPU:                Intel Core i7-9700K (Coffee Lake-S, P0)
                       3600 MHz (36.00x100.0) @ 4620 MHz (46.00x100.4)
Motherboard:  ASUS ROG MAXIMUS X HERO (WI-FI AC)
BIOS:              2301, 02/25/2020
Chipset:          Intel Z370 (Kaby Lake)
Memory:        32768 MBytes @ 1071 MHz, 15-15-15-36
                      - 16384 MB PC17000 DDR4 SDRAM - Corsair CMR32GX4M2C3200C16
                      - 16384 MB PC17000 DDR4 SDRAM - Corsair CMR32GX4M2C3200C16
Graphics:       Gainward RTX 2080 Ti
                     NVIDIA GeForce RTX 2080 Ti, 11264 MB GDDR6 SDRAM
Drive:        ST8000DM005-2EH112, 7814.0 GB, Serial ATA 6Gb/s @ 6Gb/s
Drive:        TOSHIBA HDWE160, 5860.5 GB, Serial ATA 6Gb/s @ 6Gb/s
Drive:        WDS500G2X0C-00L350, 488.4 GB, NVMe
Drive:        HL-DT-ST BD-RE  BH16NS55, BD-RE
Drive:        ASUS BC-12D2HT, BD-ROM
Sound:        Intel Kaby Lake - High Definition Audio / cAVS (Audio, Voice, Speech) [A0]
Sound:        NVIDIA TU102 - High Definition Audio Controller
Network:      Intel Ethernet Connection I219-V
Network:      RealTek Semiconductor RTL8822BE Wireless LAN 802.11ac PCIe Adapter
OS:            Microsoft Windows 10 Professional (x64) Build 18363.836 (1909/November 2019 Update)

Are your sure your system is stable, not overclocked and has no heat and/or memory issues?

I will run a check for memory issue. The system is watercooled.

Also check your free space (Hybrid does not delete temp files when a job crashes).

Enough free space and I was deleting the temp file manually after every crash

[Selur]

Hmm,... still can't reproduce the issue.
Try cutting the video with mkvtoolnix by:

• download mkvtoolnix portable (or the installer) from https://www.fosshub.com/MKVToolNix.html (I use the portable 64bit version)
  
• install/extract it
  
• start mkvtoolnix-gui
  
• load your file
  
• go to Output->Splitting
  
• set Splitting->Split mode to 'After output size'
  
• set Splitting->Duration to 00:01:00
  
• press 'Start multiplexing' (at the bottom), this will tell mkvtoolnix to split the file in 1min chunks
  

After a few seconds trigger 'Job queue->Stop job queue->Abort all running jobs and abort imediately', otherwise mkvtoolnix will process the whole file. Now go to the output folder delete all but one of the 1min clips (not the last as it is probably broken due to the abortion).
Then:
1. Check that you can reproduce the problem in Hybrid with that chunk.
2. If you can reproduce the issue, share that file with me. (should be ~210MB so sharing will go way faster)

Cu Selur

[Devilman1]

I did what you said and I'm not able to reproduce the error, the onlyu thing is that if I jump throught the file I don't have audio, while I have it if I play the whole file.

The audio file has no issue if I jump through it.