Replace Specific Frames and Interpolate Them?

[Selur]

ReplaceSingle is the filter which should do this.
From your description, you should try whether it helps, to set SCD to 0, to disable scene change detection.
Would need a sample of the original to say whether other filters might be better suited.

Cu Selur