IFRNetOptions

Options & Configuration · AiDotNet.Video.Options

Configuration options for IFRNet, the intermediate feature refine network for efficient frame interpolation (Kong et al., CVPR 2022).

Inheritance: ModelOptions → NeuralNetworkOptions → IFRNetOptions

For Beginners

IFRNet encodes both frames into a four-level pyramid, then decodes from the coarsest level up, each decoder refining the two motions from the in-between frame and a feature of the in-between frame itself; the last one also predicts how to blend the two warped frames and a correction.

How It Works

The defaults are IFRNet’s (ltkong218/IFRNet, models/IFRNet.py); Large and Small return IFRNet-L’s and IFRNet-S’s. Training follows train_vimeo90k.py.

Constructors

Constructor Summary
IFRNetOptions() Initializes a new instance with default values.
IFRNetOptions(IFRNetOptions other) Initializes a new instance by copying from another instance.

Properties

Property Summary
OnnxModelOptions OnnxOptions { get; set; } Gets or sets the ONNX runtime options.
double GeometryWeight { get; set; } Gets or sets the weight of the geometry consistency loss on the refined intermediate features (0.01).
double LearningRate { get; set; } Gets or sets AdamW’s initial learning rate (1e-4).
double MinLearningRate { get; set; } Gets or sets the rate the cosine schedule ends at (1e-5).
double WeightDecay { get; set; } Gets or sets AdamW’s weight decay (0).
int FirstKernelSize { get; set; } Gets or sets the encoder’s first convolution kernel (3; IFRNet-L uses 7).
int SideChannels { get; set; } Gets or sets the decoders’ ResBlock side channels (32).
int TotalIterations { get; set; } Gets or sets the cosine schedule’s length: 300 epochs of Vimeo90K’s 51,312 triplets at batch 24.
int[] EncoderChannels { get; set; } Gets or sets the encoder pyramid’s four widths, 1/2 to 1/16 size (32, 48, 72, 96).
string ModelPath { get; set; } Gets or sets the path to the ONNX model file.

Methods

Method Summary
IFRNetOptions Large() IFRNet-L (models/IFRNet_L.py): wider, with a 7x7 first convolution.
IFRNetOptions Small() IFRNet-S (models/IFRNet_S.py).