ABMEOptions

Options & Configuration · AiDotNet.Video.Options

Configuration options for ABME, asymmetric bilateral motion estimation for video frame interpolation (Park et al., ICCV 2021).

Inheritance: ModelOptions → NeuralNetworkOptions → ABMEOptions

For Beginners

ABME first estimates one motion for both frames, mirrored around the middle; a second network then lets the motion toward each frame differ, and a third network blends the two warped frames into the middle one.

How It Works

The widths and displacements default to the authors’ release (JunHeum/ABME, model/SBMNet.py, model/ABMNet.py, model/SynthesisNet.py); the training defaults to the paper (Sec. 4.1).

Constructors

Constructor Summary
ABMEOptions() Initializes a new instance with default values.
ABMEOptions(ABMEOptions other) Initializes a new instance by copying from another instance.

Properties

Property Summary
AbmeTrainingStage Stage { get; set; } Gets or sets the stage training runs (Synthesis, the last, which trains all three networks).
OnnxModelOptions OnnxOptions { get; set; } Gets or sets the ONNX runtime options.
double CensusWeight { get; set; } Gets or sets the census loss’s weight against the Charbonnier term (1, the paper’s unweighted sum).
double CharbonnierEpsilon { get; set; } Gets or sets the Charbonnier penalty’s ε (1e-6; the exponent is ½).
double DecayRate { get; set; } Gets or sets the factor the rate is multiplied by at each milestone (0.5).
double LearningRate { get; set; } Gets or sets Adam’s initial learning rate, the same at every stage (1e-4).
int AsymmetricDisplacement { get; set; } Gets or sets the asymmetric refiner’s correlation displacement (2).
int[] AsymmetricDecoderWidths { get; set; } Gets or sets the five widths of each of the asymmetric refiner’s dense decoders (64, 64, 48, 32, 16).
int[] AsymmetricEncoderWidths { get; set; } Gets or sets the asymmetric refiner’s two encoder widths (16, 32).
int[] AsymmetricMilestones { get; set; } Gets or sets the asymmetric stage’s halving steps: 1e-4 to 0.12M, then every 0.06M of 0.3M.
int[] SymmetricDecoderWidths { get; set; } Gets or sets the five widths of each of the symmetric estimator’s dense decoders (128, 128, 96, 64, 32).
int[] SymmetricDisplacements { get; set; } Gets or sets the bilateral correlation’s maximum displacement at the symmetric estimator’s levels 6 to 2 (6, 4, 4, 2, 2).
int[] SymmetricEncoderWidths { get; set; } Gets or sets the symmetric estimator’s six encoder widths (16, 32, 64, 96, 128, 196).
int[] SymmetricMilestones { get; set; } Gets or sets the symmetric stage’s halving steps: 1e-4 to 0.1M, then every 0.04M of 0.2M.
int[] SynthesisMilestones { get; set; } Gets or sets the synthesis stage’s halving steps: 1e-4 to 0.35M, then every 0.15M of 0.8M.
int[] SynthesisWidths { get; set; } Gets or sets the synthesis network’s feature-pyramid and GridNet row widths (32, 64, 96).
string ModelPath { get; set; } Gets or sets the path to the ONNX model file.