TTVSROptions

Options & Configuration · AiDotNet.Video.Options

Configuration options for TTVSR, the trajectory-aware transformer for video super-resolution.

Inheritance: ModelOptions → NeuralNetworkOptions → TTVSROptions

For Beginners

TTVSR follows where each patch of the picture moves through the video, and borrows detail from the same patch in earlier frames along that path, even many frames back.

How It Works

Defaults follow Liu et al., CVPR 2022, and the authors’ release (researchmm/TTVSR, TTVSRNet and configs/TTVSR_reds4.py): 64-channel features, 60 residual blocks in the shared propagation trunk, 4x4 tokens, keyframes every third frame, x4 upsampling, 50-frame training clips, Charbonnier loss, and Adam (0.9, 0.99) at 2e-4 with SPyNet at 0.125 times the rate and frozen for the first 5,000 iterations, cosine-annealed to 1e-7 over 400,000 iterations.

Constructors

Constructor Summary
TTVSROptions() Initializes a new instance with default values.
TTVSROptions(TTVSROptions other) Initializes a new instance by copying from another instance.

Properties

Property Summary
OnnxModelOptions OnnxOptions { get; set; } Gets or sets the ONNX runtime options.
double CharbonnierEpsilon { get; set; } Gets or sets the Charbonnier ε; the release’s loss is sqrt(d² + 1e-12), so ε = 1e-6.
double LearningRate { get; set; } Gets or sets Adam’s starting learning rate (2e-4).
double MinLearningRate { get; set; } Gets or sets the floor of the cosine schedule (1e-7).
double SpyNetLearningRateMultiplier { get; set; } Gets or sets the multiplier of SPyNet’s learning rate (0.125, i.e.
int CosineIterations { get; set; } Gets or sets the iterations of the cosine schedule (400,000).
int FlowFreezeIterations { get; set; } Gets or sets the iterations SPyNet stays frozen at the start of training (5,000).
int KeyframeStride { get; set; } Gets or sets the keyframe spacing whose tokens later frames attend to (3).
int MidChannels { get; set; } Gets or sets the feature channels of the propagation branches (64).
int NumFrames { get; set; } Gets or sets the frames of a training clip (50, the REDS recipe).
int NumResBlocks { get; set; } Gets or sets the residual blocks of the propagation trunk both directions share (60).
int TokenStride { get; set; } Gets or sets the token size (4): frames are split into TokenStride x TokenStride tokens, and their sizes must be multiples of it.
string ModelPath { get; set; } Gets or sets the path to the ONNX model file.