TensorRTConverter<T, TInput, TOutput>
Models & Types · AiDotNet.Deployment.TensorRT
Converts models to TensorRT optimized format for NVIDIA GPU deployment. Properly integrates with IFullModel architecture.
For Beginners
TensorRTConverter provides AI safety functionality. Default values follow the original paper settings.
Constructors
| Constructor | Summary |
|---|---|
TensorRTConverter() |
Methods
| Method | Summary |
|---|---|
byte[] ConvertToTensorRTBytes(IFullModel<T, TInput, TOutput> model, TensorRTConfiguration config) |
Converts a model to TensorRT format and returns as byte array. |
void ConvertToTensorRT(IFullModel<T, TInput, TOutput> model, string outputPath, TensorRTConfiguration config) |
Converts a model to TensorRT format. |