[HELP] 264 is too small

[Selur]

Does the Avisynth Preview work properly?
Is your system overclocked?
What cpu do you use?
Try disabling 'Config->Internals->Avisynth->Prefer FFmpeg as decoder' and enable 'Config->Internals->Avisynth->Prefer avs2yuvas decoder'.

Encoding call:

"C:\PROGRA~1\Hybrid\32bit\ffmpeg.exe" -y -loglevel fatal -threads 4 -i "D:\Snapshot\encodingTempSynthSkript_18_51_50_9110.avs" -an -sn   -vf zscale=rangein=tv:range=tv -pix_fmt yuv420p10le -strict -1 -vsync 0  -f rawvideo - | "C:\PROGRA~1\Hybrid\64bit\x264.exe" --crf 17.00 --profile high10 --ref 16 --keyint 250 --min-keyint 0 --scenecut 40 --bframes 16 --b-bias 0 --b-pyramid normal --direct spatial --b-adapt 0 --cplxblur 20.0 --qcomp 0.7 --qblur 0.5 --mbtree --rc-lookahead 40 --ipratio 1.4 --pbratio 1.3 --chroma-qp-offset 0 --qpmin 0 --qpmax 81 --qpstep 4 --partitions i4x4,i8x8,p8x8,b8x8 --8x8dct --me umh --merange 16 --mvrange -1 --subme 10 --cabac --trellis 2 --psy-rd 1.00:0.00 --weightp 2 --aq-mode 1 --aq-strength 1.0 --nr 0 --deadzone-inter 21 --deadzone-intra 11 --cqm flat --pic-struct --threads auto --sar 1:1 --deblock 0:0 --range tv --colormatrix bt709 --demuxer raw --input-res 1280x720 --input-csp i420 --input-range tv --input-depth 10 --fps 24000/1001 --output-csp i420 --output-depth 10 --output "D:\Snapshot\18_51_50_9110_03.264" -

and the Avisynth script:

LoadCPlugin("C:\PROGRA~1\Hybrid\32bit\AVISYN~1\ffms2.dll")
LoadPlugin("C:\PROGRA~1\Hybrid\32bit\AVISYN~1\flash3kyuu_deband.dll")
SetFilterMTMode("DEFAULT_MT_MODE", MT_MULTI_INSTANCE)
# loading source: D:\Downloads\Tate no Yuusha\[HorribleSubs] Tate no Yuusha no Nariagari - 07 [720p].mkv
#  input color sampling YV12
#  input luminance scale tv
FFVideoSource("D:\DOWNLO~1\TATENO~1\_HORRI~3.MKV",cachefile="D:\Snapshot\18_51_50_9110.ffindex")
# current resolution: 1280x720
# filtering
# debanding
f3kdb(range=27,dither_algo=3,grainY=1,grainC=1,dynamic_grain=true,Y=64,Cb=64,Cr=64)
# adjusting bit depth current 8 to target 10
# convert to 10bit for encoder
ConvertBits(10, dither=1)
PreFetch(4)
return last

seem fine to me.

Cu Selur