Mixed Precision
9 public types in this namespace, organized by kind.
Models & Types (4)
| Type |
Summary |
LayerPrecisionPolicy |
Defines precision policies for different layer types during mixed-precision training. |
LossScaler<T> |
Implements dynamic loss scaling for mixed-precision training to prevent gradient underflow. |
MixedPrecisionContext |
Manages master weights (FP32) and working weights (FP16) for mixed-precision training. |
MixedPrecisionScope |
Provides an ambient context for mixed-precision operations during forward and backward passes. |
Structs (2)
| Type |
Summary |
Float8E4M3 |
Represents an 8-bit floating point number in E4M3 format (4 exponent bits, 3 mantissa bits). |
Float8E5M2 |
Represents an 8-bit floating point number in E5M2 format (5 exponent bits, 2 mantissa bits). |
Options & Configuration (1)
Helpers & Utilities (2)