Selur's Little Message Board

Full Version: low processor usage - reason?
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Hi Selur.

Was wondering, you have ever had a similar report, but here is the deal.
Once the movie encoding starts, the CPU usage goes up to 100% and remains there for a while, but at a certain % it drops significantly (to 20-30%) and stays there.
I can ensure you, there are 0 other background processes at play.
System is Win10x64, Core i7-6700, GPU usage is 0%, I forced 8 threads (for my 4x2 overall cores) on the x264 tab, but it happens also when i leave it on auto. As you can see usage is so bad, that the CPU can cut back on speed.
Vaporsynth is using MLdegrain, Finesharp, Dotkill and Hysteria.
Is this because one of these DLL are unoptimized?

Thanks.
The Filter combination you chose also uses a lot of ram on higher resolutions.
Using a 1280x720 source ant:
Code:
# Imports
import os
import sys
import vapoursynth as vs
core = vs.get_core()
# Import scripts folder
scriptPath = 'I:/Hybrid/64bit/vsscripts'
sys.path.append(os.path.abspath(scriptPath))
# Loading Plugins
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/Support/libmvtools.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/DeCrawlFilter/DotKill/dotkill64.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/SourceFilter/LSmashSource/vslsmashsource.dll")
# Import scripts
import hysteria
import hnwvsfunc
import mvsfunc
# Loading E:\to convert\test.mkv using LWLibavSource
clip = core.lsmas.LWLibavSource(source="E:\to convert\test.mkv", format="YUV420P8", cache=0)
# making sure input color matrix is set as unspec
clip = core.resize.Point(clip, matrix_in_s="unspec",range_s="limited")
# making sure frame rate is set to 24000/1001
clip = core.std.AssumeFPS(clip, fpsnum=24000, fpsden=1001)
# Setting color range to TV (limited) range.
clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1)
# DeCrawling using DotKill
clip = core.dotkill.DotKill(clip=clip, napply=3)
# removing grain using MLDegrain
clip = hnwvsfunc.MLDegrain(clip=clip, soft=[0,0,0])
# sharpening using FineSharp
clip = hnwvsfunc.FineSharp(clip=clip)
# line darkening using Hysteria
clip = hysteria.Hysteria(clip=clip,highthresh=10)
# Output
clip.set_output()
the memory usage is sky rocketing,... looks like one of the filters has a memory leak.
After ~10min, the RAM usage is > 11 GB and still increasing, so my guess is that if the same is happening on your system, you might run out of RAM. Wink

Cu Selur

Ps.: I'll do some more testing and may be add an option to Hybrid to limit the RAM usage of Vapoursynth.
PPs.: CPU usage is down to 40% now that ~16GB are used,.. my guess is that one of the filters has a bug uses more and more memory and slows down the more memory it uses (hitting 17GB now).
Got it, it's DotKill.
Replacing the file in your Hybrid\64bit\vsfilters\DeCrawlFilter\DotKill folder with the attached version should fix the issue.

Cu Selur
(23.02.2019, 09:58)Selur Wrote: [ -> ]Got it, it's DotKill.
Replacing the file in your Hybrid\64bit\vsfilters\DeCrawlFilter\DotKill folder with the attached version should fix the issue.

Cu Selur

yea, in the meantime i also got it figured out that it was dotkill.
ill try the new one, thx.

(23.02.2019, 21:28)kkf_hu Wrote: [ -> ]
(23.02.2019, 09:58)Selur Wrote: [ -> ]Got it, it's DotKill.
Replacing the file in your Hybrid\64bit\vsfilters\DeCrawlFilter\DotKill folder with the attached version should fix the issue.

Cu Selur

yea, in the meantime i also got it figured out that it was dotkill.
ill try the new one, thx.

yea it did the trick alright, thx Selur