Mixed Precision

9 public types in this namespace, organized by kind.

Models & Types (4)

Type Summary
LayerPrecisionPolicy Defines precision policies for different layer types during mixed-precision training.
LossScaler<T> Implements dynamic loss scaling for mixed-precision training to prevent gradient underflow.
MixedPrecisionContext Manages master weights (FP32) and working weights (FP16) for mixed-precision training.
MixedPrecisionScope Provides an ambient context for mixed-precision operations during forward and backward passes.

Structs (2)

Type Summary
Float8E4M3 Represents an 8-bit floating point number in E4M3 format (4 exponent bits, 3 mantissa bits).
Float8E5M2 Represents an 8-bit floating point number in E5M2 format (5 exponent bits, 2 mantissa bits).

Options & Configuration (1)

Type Summary
MixedPrecisionConfig Configuration settings for mixed-precision training.

Helpers & Utilities (2)

Type Summary
Float8Extensions Provides utility methods for working with FP8 types.
LayerPrecisionPolicyExtensions Extension methods for applying layer precision policies.