Model Serving & Deployment

45+

Production-ready model serving with encryption and license management

Deploy trained models as production services with AiDotNet.Serving. REST API and gRPC endpoints, AES-256-GCM model encryption with three-layer obfuscation, license key management for distributing models to customers, and integrated Stripe billing. Everything you need to monetize your AI models.

Model APIs SaaS AI Products Model Marketplace Enterprise Deployment Edge Inference A/B Testing Model Monetization IP Protection

Serving Infrastructure

Deploy models as scalable API endpoints with built-in monitoring.

REST API Endpoints

Auto-generated REST endpoints for any trained model with OpenAPI documentation.

gRPC Services

High-performance gRPC endpoints for low-latency inference.

Model Registry

Version, tag, and manage models with metadata and lineage tracking.

Health Checks

Readiness and liveness probes for Kubernetes-ready deployment.

Metrics & Monitoring

Request latency, throughput, error rates, and model performance metrics.

Batch Inference

Efficient batch processing for high-throughput offline prediction.

Model Protection (AES-256-GCM)

Protect your trained models from reverse-engineering and unauthorized access.

AES-256-GCM Encryption

Military-grade encryption for model weights and architecture.

Three-Layer Obfuscation

Architecture obfuscation, weight scrambling, and metadata encryption.

Runtime Decryption

Models decrypted only in memory during inference, never written to disk.

Tamper Detection

Integrity verification detecting unauthorized model modifications.

Key Rotation

Automatic encryption key rotation without model redeployment.

License Management

Distribute and monetize AI models with per-customer licensing.

License Key Generation

Generate unique license keys tied to customers, features, and expiry dates.

Self-Hosted Verification

License verification server you control - no third-party dependency.

Seat Management

Multi-seat licenses for teams and enterprise customers.

Feature Gating

Enable/disable model features based on license tier.

Usage Tracking

Monitor API calls, inference counts, and usage patterns per license.

Stripe Integration

Built-in Stripe billing for subscriptions, usage-based pricing, and invoicing.

Model serving with AiModelBuilder

C#
using AiDotNet;

// Train, encrypt, and deploy with AiModelBuilder
var result = await new AiModelBuilder<float, float[], float>()
    .ConfigureModel(new NeuralNetwork<float>(
        inputSize: 768, hiddenSize: 256, outputSize: 10))
    .ConfigureOptimizer(new AdamOptimizer<float>())
    .ConfigurePreprocessing()
    .ConfigureQuantization(new QuantizationConfig(bits: 8))
    .BuildAsync(features, labels);

// Serve as encrypted REST API with license management
result.ServeAsApi(new ServingConfig(
    port: 5000,
    encryption: new AesGcmEncryption(encryptionKey),
    licenseServer: licenseServerUrl,
    stripeWebhook: "/api/webhook"));

Start building with Model Serving & Deployment

All 45+ implementations are included free under Apache 2.0.