ABTest |
Represents a single A/B test configuration. |
AWQQuantizer<T, TInput, TOutput> |
AWQ (Activation-aware Weight Quantization) - protects important weights based on activation magnitudes. |
ActivationStatistics<T> |
Holds activation statistics collected during calibration forward passes. |
BlockQuantizationState |
Stores block-wise quantization state for efficient QAT. |
CacheStatistics |
Statistics for the model cache. |
CoreMLExporter<T, TInput, TOutput> |
Exports models to CoreML format for iOS deployment. |
DeploymentRuntime<T> |
Runtime environment for deployed models with warm-up, versioning, A/B testing, and telemetry. |
EdgeOptimizer<T, TInput, TOutput> |
Optimizer for edge device deployment with ARM NEON and other optimizations. |
EfficientQATOptimizer<T> |
EfficientQAT optimizer providing memory-efficient Quantization-Aware Training for large models. |
FP8Quantizer<T, TInput, TOutput> |
FP8 (8-bit Floating Point) quantizer supporting E4M3 and E5M2 formats. |
Float16Quantizer<T, TInput, TOutput> |
FP16 (half-precision) quantizer for model optimization. |
GPTQQuantizer<T, TInput, TOutput> |
GPTQ (Generative Pre-trained Transformer Quantization) - state-of-the-art weight quantization using second-order Hessian information to minimize reconstruction error. |
InferenceStatistics |
Statistics for TensorRT inference engine. |
Int4Quantizer<T, TInput, TOutput> |
INT4 (4-bit) quantizer for model optimization — the simple MinMax counterpart to Int8Quantizer, used for QLoRA-style low-bit base weights. |
Int8Quantizer<T, TInput, TOutput> |
INT8 quantizer for model optimization. |
LayerActivationStats<T> |
Activation statistics for a single layer. |
LayerQuantizationParams |
Per-layer quantization parameters. |
MXFP4Quantizer<T, TInput, TOutput> |
MXFP4 (Microscaling FP4) quantizer - uses shared exponents for efficient 4-bit floating point. |
ModelCache<T> |
Cache for model inference results. |
ModelStatistics |
Statistics for a model. |
ModelVersionInfo |
Public model version information. |
NF4Quantizer<T, TInput, TOutput> |
NF4 (4-bit NormalFloat) quantizer - optimal for normally distributed weights. |
NNAPIBackend<T> |
NNAPI (Neural Networks API) backend for Android deployment. |
NNAPIDeviceInfo |
Information about an NNAPI-capable device. |
NNAPIPerformanceInfo |
Performance information for NNAPI. |
OnnxGraph |
Represents an ONNX computational graph. |
OnnxModelExporter<T, TInput, TOutput> |
Exports AiDotNet models to ONNX format for cross-platform deployment. |
OnnxOperation |
Represents an ONNX operation (node in the computational graph). |
OptimizationProfile |
Represents a TensorRT optimization profile for dynamic shapes. |
PartitionedModel<T, TInput, TOutput> |
Represents a model partitioned for cloud+edge deployment. |
QATTrainingHook<T> |
Quantization-Aware Training (QAT) hook that applies fake quantization during training. |
QuIPSharpQuantizer<T, TInput, TOutput> |
QuIP# (Quantization with Incoherence Processing Sharp) quantizer for extreme 2-bit quantization. |
QuantizationState |
Stores quantization state for a layer during QAT. |
SmoothQuantQuantizer<T, TInput, TOutput> |
SmoothQuant - transfers quantization difficulty from activations to weights using per-channel smoothing. |
SpinQuantQuantizer<T, TInput, TOutput> |
SpinQuant quantizer - uses learned rotation matrices to reduce outliers before quantization. |
TFLiteExporter<T, TInput, TOutput> |
Exports models to TensorFlow Lite format for mobile deployment. |
TFLiteTargetSpec |
TensorFlow Lite target specification with detailed platform requirements. |
TelemetryCollector |
Collects telemetry data for deployed models. |
TelemetryEvent |
Represents a telemetry event. |
TensorRTConverter<T, TInput, TOutput> |
Converts models to TensorRT optimized format for NVIDIA GPU deployment. |
TensorRTInferenceEngine<T> |
High-performance inference engine for TensorRT models. |
WeightStreamingReport |
Telemetry summary for a model’s weight-streaming activity. |