Selur's Little Message Board

Full Version: Automatically remove "black frames"
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Pages: 1 2
right now after processing a footage with Hybrid .. i need to use a Linux script (FFMPEG + blackdetect  filter) to cut in pieces the clip removing the black frames interruptions (i use a blackmagic intensity PRO that generate BLACK frames when the signal is too much "noised" ) and after that i need to merge all these parts to create an output without any BLACK frame..

is possible to used the "blackdetect" filter or something similar on Hybrid to AUTOMATICALLY remove all black frames from footage? (or maybe <5% black frames)

thank you!
No, Hybrid has no filter which would:
a. remove black frames
and
b. cut the audio to keep the source sync


Cu Selur
thank you Cu Selur  Smile
Cu = see you
Selur <- the Name Smile
Can you share a small sample of such a clip (with the black frames)?
I suspect that one could use something like:
Code:
def replace_low_luma_frames(clip, threshold):
    # Calculate average luma for each frame
    luma = core.std.ShufflePlanes(clip, planes=0, colorfamily=vs.GRAY)
    avg_luma = core.std.PlaneStats(luma)

    # Create a mask of frames with luma below the threshold
    low_luma_mask = core.std.Expr(avg_luma, f'x {threshold} <')

    # Get frame before for replacement
    frame_before = core.std.Trim(clip, 0, clip.num_frames - 1)

    # Replace frames with low luma using frame_before
    replaced = core.std.MaskedMerge(clip, frame_before, low_luma_mask)

    return replaced

clip = replace_low_luma_frames(clip, 30)
(code is untested, not totally sure whether it works Wink)
to replace each frame which luma is below 30 (or lower) with the frame before it.
Assuming there are only single black frames in the soure and thus singe duplicates that one could use 'FillDrops' to replace the inserted duplicates with interpolated frames.

Cu Selur
try it - pulldown="telecine" or "interpolation"

+ tune: Grain or PSNR or SSIM
OMG very thank you helping me!
here a small interlaced sample: www.wcn.it/black.avi

i have a lot of old footages with these black frames (generated by the blackmagic intensity pro card) (there are more than 1 black consecutive frames BTW.. in the sample maybe not.. but there are)

here there are a lot of black "zones" : www.wcn.it/black2.avi
Okay, here's what you can do.
  • Start Hybrid
  • load clip
  • set 'Filtering->(De-)Interlace/Telecine->Overwrite input scan type to' to 'top field first'
  • optional: enable 'Filtering->(De-)Interlace/Telecine->QTGMC Vapoursynth->Bob'.
  • go to 'Filtering->Vapoursynth->Custom->Insert Before' set it to 'FillDrops', enable the text box below it.
  • in this custom section you now enter:
    Code:
    # replace a black frames with last frame that was not black
    def ReplaceBlackFrames(clip, thresh=0.1, debug=False):
      core = vs.core
      if not isinstance(clip, vs.VideoNode):
          raise ValueError('This is not a clip')
          
      def selectFunc(n, f):
        if f.props['PlaneStatsAverage'] > thresh or n == 0:
          if debug:
            return core.text.Text(clip=clip,text="Org, avg: "+str(f.props['PlaneStatsAverage']),alignment=8)
          return clip
        toReplace = n
        for i in range(n)[::-1]:
          if clip.get_frame(i).props['PlaneStatsAverage'] <= thresh:
            continue
          
          # remove current replace with frame before    
          start = core.std.Trim(clip, first=0, last=n-1)
          r = core.std.Trim(clip, first=i, last=i)
          end = core.std.Trim(clip, first=n+1)
          replaced = start + r + end
          break
        
        if debug:
           return core.text.Text(clip=replaced,text="Replaced, avg: "+str(f.props['PlaneStatsAverage']),alignment=8)
        return replaced
              
      clip = core.std.PlaneStats(clip)
      fixed = core.std.FrameEval(clip, selectFunc, prop_src=clip)
      return fixed

    clip = ReplaceBlackFrames(clip, thresh=0.1, debug=False)
    If you now look at the Vapoursynth Preview all black frames should be replaced with the last non-black frame.
  • optional: if there were no multiple black frames in a row, enable 'Filtering->Vapoursynth->Misc->FillDrops', this will then replace the duplicate with an interpolated version.

Cu Selur
OMG!!! very very very thank you!!!
Happy that helped, note that this will only work on clips that do not start with black frames.

Cu Selur
Pages: 1 2