Selur's Little Message Board
[BUG] Crash when encoding - Printable Version

+- Selur's Little Message Board (https://forum.selur.net)
+-- Forum: Hybrid - Support (https://forum.selur.net/forum-1.html)
+--- Forum: Problems & Questions (https://forum.selur.net/forum-3.html)
+--- Thread: [BUG] Crash when encoding (/thread-1422.html)

Pages: 1 2 3


RE: Crash when encoding - Selur - 28.06.2020

I think I found the cause of the problem, will send you a new link via PM in ~1/2 hour

Cu Selur


RE: Crash when encoding - The_Tinkerer - 28.06.2020

Thanks very much, yes I know debug stuff is usually pretty useless.

I did try completely removing Hybrid and installing only the dev version as part of troubleshooting and it still had the same problem.

I tried the version you sent, and it works! No crash! Wink 

Also, it loads VERY fast. Not sure if that's an indicator of something wrong, or just an improvement. Tongue


RE: Crash when encoding - Selur - 28.06.2020

I did some changes that should speed up loading then fontSize is set in the misc.ini and is a bit slower when the option is not used.

Cu Selur


RE: Crash when encoding - The_Tinkerer - 30.06.2020

Just got time for testing Interframe with AviSynth in dev version 2020.06.28.1. Unfortunately, it crashes. Sad

AviSynth script:

ClearAutoloadDirs() LoadCPlugin("C:\PROGRA~1\Hybrid\32bit\AVISYN~1\ffms2.dll") LoadPlugin("C:\PROGRA~1\Hybrid\32bit\AVISYN~1\svpflow1.dll") LoadPlugin("C:\PROGRA~1\Hybrid\32bit\AVISYN~1\svpflow2.dll") Import("C:\Program Files\Hybrid\32bit\avisynthPlugins\InterFrame2.avsi") SetFilterMTMode("DEFAULT_MT_MODE", MT_MULTI_INSTANCE) # loading source: E:\USER\fin\Test\Test.mp4 #  input color sampling YV12@8, matrix:Rec.601, scantyp: progressive #  input luminance scale tv FFVideoSource("E:\USER\fin\Test\Test.mp4",colorspace="YV12") # current resolution: 656x480 InterFrame(NewNum=60000,NewDen=1001,OverrideAlgo=23,Tuning="Weak",Cores=16) # filtering PreFetch(4) return last


Debug file attached!

[attachment=922]

I tried with Vapoursynth, and I seem to have the same symptoms as the original poster. After 100%, the processing continues as the processing speed increases (the fps in the title bar gradually continues to go up) and the file size gradually continues to decrease. I stopped it at 2000%.

Vapoursynth script:

# Imports import os import sys import vapoursynth as vs core = vs.get_core() # Import scripts folder scriptPath = 'C:/Program Files/Hybrid/64bit/vsscripts' sys.path.append(os.path.abspath(scriptPath)) # Loading Plugins core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/FrameFilter/Interframe/svpflow2_vs64.dll") core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/FrameFilter/Interframe/svpflow1_vs64.dll") core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/SourceFilter/LSmashSource/vslsmashsource.dll") # Import scripts import havsfunc # input color space: YUV420P8, bit depth: 8, resolution: 656x480, fps: 25 # Loading E:\USER\fin\Test\Test.mp4 using LibavSMASHSource clip = core.lsmas.LibavSMASHSource(source="E:/USER/fin/Test/Test.mp4",fpsnum=25) # making sure input color matrix is set as 470bg clip = core.resize.Point(clip, matrix_in_s="470bg",range_s="limited") # making sure frame rate is set to 25 clip = core.std.AssumeFPS(clip, fpsnum=25, fpsden=1) # Setting color range to TV (limited) range. clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1) # adjusting frame count with Interframe/SVP clip = havsfunc.InterFrame(clip, Tuning="weak", NewNum=60000, NewDen=1001, OverrideAlgo=23) # new fps: 59.94 # Output clip.set_output()


Debug file attached!

[attachment=923]

In troubleshooting the AviSynth crash, I found it seems to be related to the versions of svpflow1.dll and svpflow2.dll in the avisynthPlugins directory.

I replaced the versions that Hybrid 2020.06.28.1 installed (same as release version 2020.06.21.1):

CRC32            Size  Name -------- -------------  ------------ E66573AE        374784  svpflow1.dll 6A7C9596        399360  svpflow2.dll



...with the older versions that were installed with Hybrid 2020.02.19.1:

CRC32            Size  Name -------- -------------  ------------ 0586759C        517632  svpflow1.dll ABA31676        647680  svpflow2.dll



Now Hybrid works as expected without crashing.

Debug file of successful run with the older svpflow dll's attached!

[attachment=924]


RE: Crash when encoding - The_Tinkerer - 30.06.2020

I tried the same "trick" with VapourSynth, replacing the current svpflow1_vs64.dll and svpflow2_vs64.dll files (2020.06.28.1 and 2020.06.21.1) with the older files from version 2020.02.19.1.

In this case it made no difference; it has the same symptoms. The percent goes over 100 and increases in processing speed... this time however it ended with a vspipe.exe crash.

Log Name:      Application Source:        Application Error Date:          6/30/2020 3:15:02 AM Event ID:      1000 Task Category: (100) Level:        Error Keywords:      Classic User:          N/A Computer:      WIN-7DHRTQH0CV9 Description: Faulting application name: vspipe.exe, version: 0.0.0.0, time stamp: 0x5eb576f6 Faulting module name: vslsmashsource.dll, version: 0.0.0.0, time stamp: 0x5ed3a751 Exception code: 0xc0000005 Fault offset: 0x000000000093cd00 Faulting process id: 0x15a0 Faulting application start time: 0x01d64ead633605dc Faulting application path: C:\Program Files\Hybrid\64bit\Vapoursynth\vspipe.exe Faulting module path: C:\Program Files\Hybrid\64bit\vsfilters\SourceFilter\LSmashSource\vslsmashsource.dll Report Id: 699f4062-baa1-11ea-94ab-0050560b8935 Event Xml: <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">   <System>     <Provider Name="Application Error" />     <EventID Qualifiers="0">1000</EventID>     <Level>2</Level>     <Task>100</Task>     <Keywords>0x80000000000000</Keywords>     <TimeCreated SystemTime="2020-06-30T07:15:02.000000000Z" />     <EventRecordID>627626</EventRecordID>     <Channel>Application</Channel>     <Computer>WIN-7DHRTQH0CV9</Computer>     <Security />   </System>   <EventData>     <Data>vspipe.exe</Data>     <Data>0.0.0.0</Data>     <Data>5eb576f6</Data>     <Data>vslsmashsource.dll</Data>     <Data>0.0.0.0</Data>     <Data>5ed3a751</Data>     <Data>c0000005</Data>     <Data>000000000093cd00</Data>     <Data>15a0</Data>     <Data>01d64ead633605dc</Data>     <Data>C:\Program Files\Hybrid\64bit\Vapoursynth\vspipe.exe</Data>     <Data>C:\Program Files\Hybrid\64bit\vsfilters\SourceFilter\LSmashSource\vslsmashsource.dll</Data>     <Data>699f4062-baa1-11ea-94ab-0050560b8935</Data>   </EventData> </Event>


Debug file attached!

[attachment=925]


RE: Crash when encoding - Selur - 30.06.2020

1. the dlls that came with the dev version should be fine.
2. if you take dlls from an older version you need to also adjust the interframe script.
3. if you switch the avisynth dlls you additionally might need reinstall the gpu drivers
4. the last crash seems to be cased by a memory access problem of the source filter.
-> I'll create a new dev version for you and will send you a link via PM, do not change the dlls in it.

Cu Selur


RE: Crash when encoding - The_Tinkerer - 01.07.2020

Thanks so much for the dev versions!

2020.06.30.1 fixes the AviSynth crash.

However, the Vapoursynth problem remains. On my test, it ran what looked to be normally at about 45 fps until it gets to 100%. Then it keeps going, and speeds up, as estimated file size goes down. I stopped it at over 2000%, running at 323 fps, with estimated file size of 2.38 mb. Tongue

[attachment=926]


RE: Crash when encoding - Selur - 01.07.2020

I'll look at it after work today.

Cu Selur


RE: Crash when encoding - Selur - 01.07.2020

Can't reproduce this here.
Looking at the debug output,...
Sadly the debug output does not contain the analysis of the source or the job creation.
I see that Hybrid assumes that the input has 4838 but x264 encodes way more frames.
(Hybrid adjusts the frame count to 11600 frames due to Interframe usage.)
Which explains why Hybrid shows a progress over 100%, but not why it is that much 'off' from the actual frame count.

the encoding call:
"C:\Program Files\Hybrid\64bit\Vapoursynth\vspipe.exe" "C:\Users\Administrator\AppData\Local\Temp\encodingTempSynthSkript_2020-06-30@20_01_22_2010.vpy" - --y4m | "C:\Program Files\Hybrid\64bit\x264.exe" --preset veryslow --crf 18.00 --profile high --level 4.1 --sync-lookahead 12 --vbv-maxrate 62500 --vbv-bufsize 78125 --sar 1:1 --non-deterministic --range tv --colormatrix bt470bg --demuxer y4m --input-range tv --fps 60000/1001 --output-depth 8 --output "C:\Users\ADMINI~1\AppData\Local\Temp\2020-06-30@20_01_22_2010_02.264" -
and the Vapoursynth script:
# Imports import os import sys import vapoursynth as vs core = vs.get_core() # Import scripts folder scriptPath = 'C:/Program Files/Hybrid/64bit/vsscripts' sys.path.append(os.path.abspath(scriptPath)) # Loading Plugins core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/FrameFilter/Interframe/svpflow2_vs64.dll") core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/FrameFilter/Interframe/svpflow1_vs64.dll") core.std.LoadPlugin(path="C:/Program Files/Hybrid/64bit/vsfilters/SourceFilter/LSmashSource/vslsmashsource.dll") # Import scripts import havsfunc # input color space: YUV420P8, bit depth: 8, resolution: 656x480, fps: 25 # Loading E:\USER\fin\Test\Test.mp4 using LibavSMASHSource clip = core.lsmas.LibavSMASHSource(source="E:/USER/fin/Test/Test.mp4",fpsnum=25) # making sure input color matrix is set as 470bg clip = core.resize.Point(clip, matrix_in_s="470bg",range_s="limited") # making sure frame rate is set to 25 clip = core.std.AssumeFPS(clip, fpsnum=25, fpsden=1) # Setting color range to TV (limited) range. clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1) # adjusting frame count with Interframe/SVP clip = havsfunc.InterFrame(clip, Tuning="weak", NewNum=60000, NewDen=1001, OverrideAlgo=23) # new fps: 59.94 # Output
seem fine.

My current speculation is that:
1. the source if vfr
2. Hybrid adjusts the frame count to the number of time codes found in the source
3. the source is broken in a way that the time code count is way lower than the frame count.

Problem with that speculation is, is that this should have the same effect independent whether Avisynth or Vapoursynth is used.

-> without more details, that is all I can say.

Cu Selur


RE: Crash when encoding - The_Tinkerer - 01.07.2020

The source is CFR and works with AviSynth:

General Count                                    : 331 Count of stream of this kind            : 1 Kind of stream                          : General Kind of stream                          : General Stream identifier                        : 0 Count of video streams                  : 1 Count of audio streams                  : 1 Video_Format_List                        : AVC Video_Format_WithHint_List              : AVC Codecs Video                            : AVC Audio_Format_List                        : AAC LC Audio_Format_WithHint_List              : AAC LC Audio codecs                            : AAC LC Audio_Language_List                      : English Complete name                            : E:\USER\fin\Test\Test.mp4 Folder name                              : E:\USER\fin\Test File name extension                      : Test.mp4 File name                                : Test File extension                          : mp4 Format                                  : MPEG-4 Format                                  : MPEG-4 Format/Extensions usually used          : braw mov mp4 m4v m4a m4b m4p m4r 3ga 3gpa 3gpp 3gp 3gpp2 3g2 k3g jpm jpx mqv ismv isma ismt f4a f4b f4v Commercial name                          : MPEG-4 Format profile                          : Base Media Internet media type                      : video/mp4 Codec ID                                : isom Codec ID                                : isom (isom/iso2/avc1/mp41) Codec ID/Url                            : http://www.apple.com/quicktime/download/standalone.html CodecID_Compatible                      : isom/iso2/avc1/mp41 File size                                : 19975235 File size                                : 19.0 MiB File size                                : 19 MiB File size                                : 19 MiB File size                                : 19.0 MiB File size                                : 19.05 MiB Duration                                : 193585 Duration                                : 3 min 13 s Duration                                : 3 min 13 s 585 ms Duration                                : 3 min 13 s Duration                                : 00:03:13.585 Duration                                : 00:03:13:13 Duration                                : 00:03:13.585 (00:03:13:13) Overall bit rate                        : 825487 Overall bit rate                        : 825 kb/s Frame rate                              : 25.000 Frame rate                              : 25.000 FPS Frame count                              : 4838 Stream size                              : 149268 Stream size                              : 146 KiB (1%) Stream size                              : 146 KiB Stream size                              : 146 KiB Stream size                              : 146 KiB Stream size                              : 145.8 KiB Stream size                              : 146 KiB (1%) Proportion of this stream                : 0.00747 HeaderSize                              : 40 DataSize                                : 19825975 FooterSize                              : 149220 IsStreamable                            : No File creation date                      : UTC 2020-06-30 05:59:00.584 File creation date (local)              : 2020-06-30 01:59:00.584 File last modification date              : UTC 2019-12-30 07:33:18.000 File last modification date (local)      : 2019-12-30 03:33:18.000 Writing application                      : Lavf58.27.103 Writing application                      : Lavf58.27.103 Video Count                                    : 378 Count of stream of this kind            : 1 Kind of stream                          : Video Kind of stream                          : Video Stream identifier                        : 0 StreamOrder                              : 0 ID                                      : 1 ID                                      : 1 Format                                  : AVC Format                                  : AVC Format/Info                              : Advanced Video Codec Format/Url                              : http://developers.videolan.org/x264.html Commercial name                          : AVC Format profile                          : Main@L3 Format settings                          : CABAC / 3 Ref Frames Format settings, CABAC                  : Yes Format settings, CABAC                  : Yes Format settings, Reference frames        : 3 Format settings, Reference frames        : 3 frames Internet media type                      : video/H264 Codec ID                                : avc1 Codec ID/Info                            : Advanced Video Coding Duration                                : 193520 Duration                                : 3 min 13 s Duration                                : 3 min 13 s 520 ms Duration                                : 3 min 13 s Duration                                : 00:03:13.520 Duration                                : 00:03:13:13 Duration                                : 00:03:13.520 (00:03:13:13) Bit rate                                : 691551 Bit rate                                : 692 kb/s Width                                    : 656 Width                                    : 656 pixels Height                                  : 480 Height                                  : 480 pixels Sampled_Width                            : 656 Sampled_Height                          : 480 Pixel aspect ratio                      : 1.000 Display aspect ratio                    : 1.367 Display aspect ratio                    : 4:3 Rotation                                : 0.000 Frame rate mode                          : CFR Frame rate mode                          : Constant FrameRate_Mode_Original                  : VFR Frame rate                              : 25.000 Frame rate                              : 25.000 FPS Frame count                              : 4838 Color space                              : YUV Chroma subsampling                      : 4:2:0 Chroma subsampling                      : 4:2:0 Bit depth                                : 8 Bit depth                                : 8 bits Scan type                                : Progressive Scan type                                : Progressive Bits/(Pixel*Frame)                      : 0.088 Stream size                              : 16728611 Stream size                              : 16.0 MiB (84%) Stream size                              : 16 MiB Stream size                              : 16 MiB Stream size                              : 16.0 MiB Stream size                              : 15.95 MiB Stream size                              : 16.0 MiB (84%) Proportion of this stream                : 0.83747 Title                                    : ISO Media file produced by Google Inc. Writing library                          : x264 - core 155 r2901 7d0ff22 Writing library                          : x264 core 155 r2901 7d0ff22 Encoded_Library_Name                    : x264 Encoded_Library_Version                  : core 155 r2901 7d0ff22 colour_description_present              : Yes colour_description_present_Source        : Stream Color range                              : Limited colour_range_Source                      : Stream colour_primaries_Source                  : Stream transfer_characteristics_Source          : Stream Matrix coefficients                      : BT.601 matrix_coefficients_Source              : Stream Codec configuration box                  : avcC Audio Count                                    : 280 Count of stream of this kind            : 1 Kind of stream                          : Audio Kind of stream                          : Audio Stream identifier                        : 0 StreamOrder                              : 1 ID                                      : 2 ID                                      : 2 Format                                  : AAC Format                                  : AAC LC Format/Info                              : Advanced Audio Codec Low Complexity Commercial name                          : AAC Format_AdditionalFeatures                : LC Codec ID                                : mp4a-40-2 Duration                                : 193585 Duration                                : 3 min 13 s Duration                                : 3 min 13 s 585 ms Duration                                : 3 min 13 s Duration                                : 00:03:13.585 Duration                                : 00:03:13:38 Duration                                : 00:03:13.585 (00:03:13:38) Bit rate mode                            : CBR Bit rate mode                            : Constant Bit rate                                : 127999 Bit rate                                : 128 kb/s Channel(s)                              : 2 Channel(s)                              : 2 channels Channel positions                        : Front: L R Channel positions                        : 2/0/0 Channel layout                          : L R Samples per frame                        : 1024 Sampling rate                            : 44100 Sampling rate                            : 44.1 kHz Samples count                            : 8537099 Frame rate                              : 43.066 Frame rate                              : 43.066 FPS (1024 SPF) Frame count                              : 8337 Compression mode                        : Lossy Compression mode                        : Lossy Stream size                              : 3097356 Stream size                              : 2.95 MiB (16%) Stream size                              : 3 MiB Stream size                              : 3.0 MiB Stream size                              : 2.95 MiB Stream size                              : 2.954 MiB Stream size                              : 2.95 MiB (16%) Proportion of this stream                : 0.15506 Title                                    : ISO Media file produced by Google Inc. Language                                : en Language                                : English Language                                : English Language                                : en Language                                : eng Language                                : en Default                                  : Yes Default                                  : Yes Alternate group                          : 1 Alternate group                          : 1


This seems to be the same problem the original poster reported:

(21.06.2020, 21:24)AndreyRGW Wrote: UPD2: When using Vapoursynth, percentages are off-scale, and the video cannot be saved. https://drive.google.com/file/d/1DhsPjdpUnLJ77Zz9L3J2Upkb8HoKIyJr/view


Here's my source file: https://drive.google.com/file/d/16K2TmSl2PpbLOu-Hh1JwHPj9vxLMQHHK/view