IFRNetOptions
Options & Configuration · AiDotNet.Video.Options
Configuration options for IFRNet, the intermediate feature refine
network for efficient frame interpolation (Kong et al., CVPR 2022).
Inheritance: ModelOptions → NeuralNetworkOptions → IFRNetOptions
For Beginners
IFRNet encodes both frames into a four-level pyramid, then decodes from the coarsest level up, each decoder refining the two motions from the in-between frame and a feature of the in-between frame itself; the last one also predicts how to blend the two warped frames and a correction.
How It Works
The defaults are IFRNet’s (ltkong218/IFRNet, models/IFRNet.py); Large and Small return
IFRNet-L’s and IFRNet-S’s. Training follows train_vimeo90k.py.
Constructors
| Constructor | Summary |
|---|---|
IFRNetOptions() |
Initializes a new instance with default values. |
IFRNetOptions(IFRNetOptions other) |
Initializes a new instance by copying from another instance. |
Properties
| Property | Summary |
|---|---|
OnnxModelOptions OnnxOptions { get; set; } |
Gets or sets the ONNX runtime options. |
double GeometryWeight { get; set; } |
Gets or sets the weight of the geometry consistency loss on the refined intermediate features (0.01). |
double LearningRate { get; set; } |
Gets or sets AdamW’s initial learning rate (1e-4). |
double MinLearningRate { get; set; } |
Gets or sets the rate the cosine schedule ends at (1e-5). |
double WeightDecay { get; set; } |
Gets or sets AdamW’s weight decay (0). |
int FirstKernelSize { get; set; } |
Gets or sets the encoder’s first convolution kernel (3; IFRNet-L uses 7). |
int SideChannels { get; set; } |
Gets or sets the decoders’ ResBlock side channels (32). |
int TotalIterations { get; set; } |
Gets or sets the cosine schedule’s length: 300 epochs of Vimeo90K’s 51,312 triplets at batch 24. |
int[] EncoderChannels { get; set; } |
Gets or sets the encoder pyramid’s four widths, 1/2 to 1/16 size (32, 48, 72, 96). |
string ModelPath { get; set; } |
Gets or sets the path to the ONNX model file. |
Methods
| Method | Summary |
|---|---|
IFRNetOptions Large() |
IFRNet-L (models/IFRNet_L.py): wider, with a 7x7 first convolution. |
IFRNetOptions Small() |
IFRNet-S (models/IFRNet_S.py). |