FrameInterpolationBase<T>
Base Classes · AiDotNet.Video
Base class for frame interpolation models that generate intermediate frames between existing frames.
Inheritance: NeuralNetworkBase<T> → VideoNeuralNetworkBase<T> → FrameInterpolationBase<T>
Implements: IShapeContract
Known derived types: ABME<T>, AMT<T>, BiMVFI<T>, DynamiCrafter<T>, EMAVFI<T>, FILM<T>, FLAVR<T>, Figan<T>, GIMMVFI<T>, IFRNet<T>, IQVFI<T>, InterpAnyClearer<T>, M2M<T>, MoG<T>, MoMo<T>, PerVFI<T>, RIFE<T>, STMFNet<T>, SoftSplat<T>, SwinVFI<T>, TLBVFI<T>, ToonCrafter<T>, UPRNet<T>, VFIMamba<T>, VFIT<T>, VFIformer<T>, XVFI<T>
For Beginners
Frame interpolation makes choppy video smoother by adding new frames in between existing ones. For example, converting 30fps video to 60fps or even 120fps. The model “imagines” what the scene looks like at the intermediate time points.
How It Works
Frame interpolation increases video frame rate by generating new frames between existing ones. This base class provides:
- Arbitrary timestep interpolation (not just midpoint)
- Multi-frame interpolation (generate multiple intermediate frames)
- Flow-based and kernel-based interpolation utilities
- Temporal consistency support
Derived classes implement specific architectures like RIFE, AMT, EMA-VFI, VFIMamba, etc.
Properties
| Property | Summary |
|---|---|
bool SupportsArbitraryTimestep { get; set; } |
Gets whether this model supports arbitrary timestep interpolation. |
int TemporalScaleFactor { get; set; } |
Methods
| Method | Summary |
|---|---|
IReadOnlyList<OutputAxisContract> OutputAxesFor(int inputRank) |
The interpolation family’s law: (F - 1) * TemporalScaleFactor + 1 output frames. |
Tensor<T> Interpolate(Tensor<T> frame0, Tensor<T> frame1, double t) |
Interpolates a single intermediate frame between two input frames at the given timestep. |
Tensor<T> InterpolateMulti(Tensor<T> frame0, Tensor<T> frame1, int numIntermediate) |
Interpolates multiple intermediate frames between two input frames. |
Tensor<T> InterpolateSequence(Tensor<T> frames) |
Interpolates all frames in a video sequence to increase frame rate. |