Mochi1PreviewModel<T>

Models & Types · AiDotNet.Diffusion.Video

Mochi 1 Preview with Asymmetric Diffusion Transformer (AsymmDiT).

Inheritance: DiffusionModelBase<T> → LatentDiffusionModelBase<T> → VideoDiffusionModelBase<T> → Mochi1PreviewModel<T>

For Beginners

Mochi 1 Preview uses an Asymmetric Diffusion Transformer (AsymmDiT) that processes text and video with different-sized networks. This asymmetry efficiently handles rich text understanding for prompt adherence while maintaining high video quality.

How It Works

References:

  • Paper: “Mochi 1: A New SOTA in Open-Source Video Generation” (Genmo, 2024)

Mochi 1 Preview is a 10B parameter model using the novel Asymmetric Diffusion Transformer (AsymmDiT) architecture, which uses different computational blocks for the conditioning and generation pathways. This asymmetry enables efficient processing of text conditions while maximizing video generation quality. Generates 480p video at 30 FPS.

Technical specifications:

  • Architecture: AsymmDiT (Asymmetric Diffusion Transformer)
  • Latent channels: 12
  • Default: 163 frames at 30 FPS
  • Supports I2V: Yes | T2V: Yes | V2V: No

Example

var options = new DiffusionModelOptions<float> { LatentChannels = 12, DefaultInferenceSteps = 64 };
var noise = Tensor<float>.CreateRandom(new[] { 1, 12, 163, 60, 106 });
var trainX = Tensor<float>.CreateRandom(4, 8);
var trainY = Tensor<float>.CreateRandom(4, 2);
var result = new AiModelBuilder<float, Tensor<float>, Tensor<float>>()
    .ConfigureModel(new Mochi1PreviewModel<float>(options: options))
    .Build(trainX, trainY);
var video = result.Predict(noise);

Constructors

Constructor Summary
Mochi1PreviewModel(NeuralNetworkArchitecture<T> architecture, DiffusionModelOptions<T> options, INoiseScheduler<T> scheduler, DiTNoisePredictor<T> predictor, TemporalVAE<T> temporalVAE, IConditioningModule<T> conditioner, int defaultNumFrames, int defaultFPS) Initializes a new instance of Mochi1PreviewModel with full customization support.

Properties

Property Summary
IConditioningModule<T> Conditioner { get; }
INoisePredictor<T> NoisePredictor { get; }
IVAEModel<T> TemporalVAE { get; }
IVAEModel<T> VAE { get; }
bool SupportsImageToVideo { get; }
bool SupportsTextToVideo { get; }
bool SupportsVideoToVideo { get; }
int LatentChannels { get; }

Methods

Method Summary
ModelMetadata<T> GetModelMetadata()